00000001:02000400:0.0F:1787756213.558157:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_hostid 00000001:02000400:0.0:1787756235.612304:0:3185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787756238.121243:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 381 MB/s 00000001:01000000:2.0F:1787756238.371985:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 466 MB/s 00000001:01000000:2.0:1787756238.621916:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3251 MB/s 00000020:02000000:2.0:1787756239.922303:0:3278:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_109_g2e03fb0 00000400:02000000:3.0:1787756240.913653:0:3293:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.121@tcp [8/256/0/180] 00008000:02000000:2.0:1787756244.294423:0:3442:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787756295.940283:0:5250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787756305.420598:0:5823:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787756305.420602:0:5823:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787756305.420736:0:5823:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005a437d60 00000080:02000400:2.0:1787756305.420746:0:5823:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787756305.426757:0:5823:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787756305.426771:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787756305.426804:0:5823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e107687d) 00000020:00000080:2.0:1787756305.426821:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787756305.471511:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787756305.472113:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787756305.512817:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787756305.512961:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787756305.512994:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787756305.513043:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787756305.513067:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787756305.514148:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787756305.514163:0:5823:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787756305.514176:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x178386880caaade5 00000020:01000004:3.0:1787756305.514187:0:5823:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787756305.514194:0:5823:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787756305.514198:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005a437d60 from MGS 00000020:01000004:3.0:1787756305.514261:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787756305.514293:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000fb21b33b) 00000020:00000080:3.0:1787756305.514306:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787756305.514427:0:5823:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005a437d60 from MGS, refs=2 00080000:01000000:3.0:1787756305.514432:0:5823:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787756305.514438:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x178386880caaadf3 00000100:00100000:3.0:1787756305.514689:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787756305.514817:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787756305.514823:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787756305.515807:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787756305.515817:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787756305.516723:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787756305.517490:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787756305.517498:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787756305.518143:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787756305.518151:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787756305.518546:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787756305.518553:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1787756305.523165:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756305.523177:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756305.523179:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756305.523719:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756305.523722:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756305.523723:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756305.524642:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787756305.529525:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787756305.773988:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3523 MB/s 00000001:01000000:2.0:1787756306.023866:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3743 MB/s 00000001:01000000:3.0:1787756306.273971:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 859 MB/s 00000001:01000000:2.0:1787756306.524483:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 607 MB/s 00080000:10000000:2.0:1787756306.538715:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1787756306.563686:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787756306.563713:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787756306.563716:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787756306.572119:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787756306.573033:0:5823:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787756306.573101:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787756306.574177:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787756306.574213:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787756306.574571:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787756306.574748:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787756306.574755:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787756306.582442:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787756306.582457:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787756306.582766:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787756306.582772:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787756306.583557:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787756306.583576:0:5823:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.121@tcp' 00000020:01000004:3.0:1787756306.583578:0:5823:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787756306.583630:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.121@tcp (typ=mgc) 00000020:00000080:3.0:1787756306.583644:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.121@tcp (00000000b6896aef) 00000020:00000080:3.0:1787756306.583661:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787756306.583733:0:5823:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000067d4dbab@MGC192.168.203.121@tcp: add connection 192.168.203.121@tcp at head 00010000:00010000:3.0:1787756306.584398:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.121@tcp-0 is initialized 00000040:01000000:3.0:1787756306.584404:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 1 is initialized 00010000:00010000:3.0:1787756306.585235:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787756306.585624:0:5838:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787756306.587103:0:5839:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787756306.587369:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.121@tcp (uuid ccd9768b-6c21-4ce9-98b3-53472f28cbb6) 00000020:00000080:3.0:1787756306.587390:0:5823:0:(genops.c:1385:class_connect()) connect: client ccd9768b-6c21-4ce9-98b3-53472f28cbb6, cookie 0x178386880caaae01 00000100:00080000:3.0:1787756306.587401:0:5823:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787756306.587406:0:5823:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import 0000000067d4dbab using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1787756306.587434:0:5823:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000016611b4f x1874598287114368/t0(0) o250->MGC192.168.203.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787756306.587463:0:5823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ccd9768b-6c21-4ce9-98b3-53472f28cbb6->MGS 00000020:01000004:3.0:1787756306.587482:0:5823:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787756306.587487:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787756306.587499:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003f8eecf2) 00000020:00000080:3.0:1787756306.587509:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787756306.587677:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016611b4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3308:1874598287114368:0@lo:250: 00000100:00100000:2.0:1787756306.587727:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756306.587927:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287114368 00000100:00100000:2.0:1787756306.587934:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287114368 00000100:00100000:2.0:1787756306.588558:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787756306.588566:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073bf1f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1874598287114368:12345-0@lo:250: 00010000:00080000:2.0:1787756306.588591:0:5835:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from ccd9768b-6c21-4ce9-98b3-53472f28cbb6@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:2.0:1787756306.588619:0:5835:0:(genops.c:1385:class_connect()) connect: client ccd9768b-6c21-4ce9-98b3-53472f28cbb6, cookie 0x178386880caaae0f 00000100:00080000:2.0:1787756306.588759:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000409ba6e4 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787756306.588859:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073bf1f51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+5:3308:x1874598287114368:12345-0@lo:250: Request processed in 292us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756306.588867:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787756306.588915:0:3308:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787756306.588923:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.121@tcp: connect to target with instance 0 00000100:00080000:2.0:1787756306.588929:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787756306.588934:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787756306.588936:0:3308:0:(import.c:65:import_set_state_nolock()) 0000000067d4dbab MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787756306.588938:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787756306.588946:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787756306.588950:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016611b4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3308:1874598287114368:0@lo:250: 00000100:00100000:3.0:1787756306.621488:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787756306.621716:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787756306.621723:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787756306.625877:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787756306.625890:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787756306.626408:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787756306.626416:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787756306.627081:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787756306.627241:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787756306.627246:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787756306.631247:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787756306.631262:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787756306.695458:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787756306.696786:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787756306.696794:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787756306.698274:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787756306.698285:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787756306.699787:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787756306.700150:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787756306.700156:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787756306.707363:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787756306.707380:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787756306.708042:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787756306.708202:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787756306.708206:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787756306.709238:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787756306.709249:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787756306.710133:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787756306.710381:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787756306.710396:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787756306.711599:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787756306.711610:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787756306.755823:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787756306.756096:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787756306.756102:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787756306.759412:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787756306.759427:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787756306.761581:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787756306.761596:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787756306.763145:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787756306.763170:0:5823:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787756306.763176:0:5823:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787756306.763302:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787756306.763337:0:5823:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.121@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787756306.763341:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787756306.763343:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787756306.763344:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787756306.763345:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787756306.763347:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787756306.763348:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787756306.763349:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787756306.763351:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787756306.763353:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787756306.763354:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787756306.763355:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787756306.763356:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787756306.763358:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787756306.763360:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787756306.763362:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787756306.763362:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787756306.763364:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787756306.763365:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787756306.763366:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787756306.763367:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787756306.763368:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787756306.763368:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787756306.763369:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787756306.763370:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787756306.763371:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787756306.763397:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787756306.763414:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000052961b1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287114496:0@lo:253: 00000100:00100000:1.0:1787756306.763511:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756306.763559:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7bf94c1 going to sleep for 11 seconds 00000100:00100000:0.0:1787756306.763719:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287114496 00000100:00100000:0.0:1787756306.763726:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287114496 00000100:00100000:0.0:1787756306.763776:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787756306.763784:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c18651d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+5:5823:x1874598287114496:12345-0@lo:253: 20000000:01000000:0.0:1787756306.763827:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787756306.763861:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787756306.764187:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787756306.764246:0:5837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787756306.764499:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787756306.765962:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787756306.766218:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787756306.766222:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787756306.766227:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787756306.766230:0:5837:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787756306.766244:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787756306.766451:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787756306.766683:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787756306.766696:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787756306.766741:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787756306.766789:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787756306.766826:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787756306.766956:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787756306.766964:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787756306.767056:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787756306.767064:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787756306.767100:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787756306.767107:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787756306.767152:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787756306.767207:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787756306.767236:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787756306.767240:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787756306.767258:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787756306.767458:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787756306.767468:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787756306.767502:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787756306.767536:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787756306.767582:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787756306.767593:0:5837:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787756306.767679:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787756306.767687:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787756306.767747:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787756306.767799:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787756306.767882:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787756306.767894:0:5837:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787756306.768028:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787756306.768037:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787756306.768085:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787756306.768132:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787756306.768318:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787756306.768366:0:5837:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787756306.768373:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787756306.769325:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787756306.769676:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787756306.769706:0:5837:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.121@tcp for mdt 20000000:01000000:0.0:1787756306.769708:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:0.0:1787756306.769774:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787756306.769789:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787756306.769868:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787756306.769877:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:0.0:1787756306.769950:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787756306.769961:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787756306.770010:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787756306.770063:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787756306.770141:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787756306.770150:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787756306.770154:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787756306.770186:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787756306.770189:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787756306.770217:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787756306.770219:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787756306.770685:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787756306.772783:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787756306.772826:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787756306.772943:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1787756306.772964:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787756306.772966:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787756306.773361:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787756306.773571:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787756306.773609:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787756306.773641:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787756306.773654:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787756306.773656:0:5837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787756306.773661:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787756306.773663:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787756306.773668:0:5837:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787756306.773674:0:5837:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787756306.774062:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787756306.774158:0:5837:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787756306.781483:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787756306.781539:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787756306.781650:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787756306.781673:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787756306.781695:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c90826d3/0x178386880caaae16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756306.781711:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c90826d3/0x178386880caaae16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756306.781720:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c90826d3/0x178386880caaae16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756306.781727:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c90826d3/0x178386880caaae16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756306.781732:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c90826d3/0x178386880caaae16 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756306.781739:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c90826d3/0x178386880caaae16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756306.781745:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c90826d3 already unused, calling callback (000000001c3fef05) 00010000:00010000:1.0:1787756306.781748:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c90826d3/0x178386880caaae16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756306.781755:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c90826d3/0x178386880caaae16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756306.781767:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c90826d3/0x178386880caaae16 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756306.781784:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c90826d3/0x178386880caaae16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756306.781789:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c90826d3/0x178386880caaae16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787756306.781806:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787756307.160952:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c18651d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+5:5823:x1874598287114496:12345-0@lo:253: Request processed in 397158us (397431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756307.160984:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787756307.164028:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000052961b1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287114496:0@lo:253: 10000000:01000000:3.0:1787756307.164051:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787756307.164054:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787756307.164056:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787756307.164057:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787756307.164059:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787756307.164060:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787756307.164061:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787756307.164062:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787756307.164064:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787756307.164065:0:5823:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787756307.164067:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787756307.164068:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787756307.164301:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005a437d60 from lustre-MDT0000 10000000:01000000:2.0:1787756307.164329:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787756307.164332:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787756307.164336:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff98af87ff1a48 10000000:01000000:2.0:1787756307.164340:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787756307.164348:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98af87ff1a48 from 1 10000000:01000000:2.0:1787756307.164351:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787756307.164389:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 00000000eb720326/0x178386880caaae1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756307.164400:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 00000000eb720326/0x178386880caaae1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756307.164409:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 00000000eb720326/0x178386880caaae1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756307.164427:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072ad9075 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287114624:0@lo:101: 00000100:00100000:2.0:1787756307.164491:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756307.164613:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a001ffe going to sleep for 11 seconds 00000100:00100000:3.0:1787756307.165920:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287114624 00000100:00100000:3.0:1787756307.165939:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287114624 00000100:00100000:0.0:1787756307.170260:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787756307.170282:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ae26802 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+5:5823:x1874598287114624:12345-0@lo:101: 00010000:00010000:0.0:1787756307.170301:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756307.170325:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ff8e15c/0x178386880caaae24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaae1d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.170364:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ff8e15c/0x178386880caaae24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaae1d expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.170376:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ff8e15c/0x178386880caaae24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaae1d expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.170385:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ff8e15c, rc 0) 00000100:00100000:0.0:1787756307.170465:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ae26802 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+6:5823:x1874598287114624:12345-0@lo:101: Request processed in 194us (5975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756307.170473:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787756307.171550:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072ad9075 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287114624:0@lo:101: 00010000:00010000:1.0:1787756307.171574:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 00000000eb720326/0x178386880caaae1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756307.171585:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 00000000eb720326/0x178386880caaae1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756307.171656:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287114752:0@lo:501: 00000100:00100000:1.0:1787756307.171718:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756307.171772:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7762dff going to sleep for 11 seconds 00000100:00100000:0.0:1787756307.172095:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287114752 00000100:00100000:0.0:1787756307.172101:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287114752 00000100:00100000:0.0:1787756307.172147:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787756307.172154:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e233d9d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+6:5823:x1874598287114752:12345-0@lo:501: 00000100:00100000:0.0:1787756307.172374:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e233d9d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+6:5823:x1874598287114752:12345-0@lo:501: Request processed in 220us (656us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787756307.172381:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787756307.173017:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287114752:0@lo:501: 10000000:01000000:1.0:1787756307.173056:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787756307.173081:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 00000000eb720326/0x178386880caaae1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756307.173091:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 00000000eb720326/0x178386880caaae1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756307.173112:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98af903a6800 10000000:01000000:1.0:1787756307.173117:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787756307.173121:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff98af903a6800 10000000:01000000:1.0:1787756307.173123:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787756307.173126:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff98af903a6800 from 1 10000000:01000000:1.0:1787756307.173129:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787756307.173225:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 00000000c90826d3/0x178386880caaae2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756307.173233:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 00000000c90826d3/0x178386880caaae2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756307.173241:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 00000000c90826d3/0x178386880caaae2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756307.173255:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287114880:0@lo:101: 00000100:00100000:1.0:1787756307.173291:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756307.173324:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7762dff going to sleep for 11 seconds 00000100:00100000:0.0:1787756307.174019:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287114880 00000100:00100000:0.0:1787756307.174027:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287114880 00000100:00100000:0.0:1787756307.174076:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787756307.174084:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b0e25ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+6:5823:x1874598287114880:12345-0@lo:101: 00010000:00010000:0.0:1787756307.174095:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756307.174122:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002fdcf710/0x178386880caaae32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaae2b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.174267:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002fdcf710/0x178386880caaae32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaae2b expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.174277:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002fdcf710/0x178386880caaae32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaae2b expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.174285:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002fdcf710, rc 0) 00000100:00100000:0.0:1787756307.174332:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b0e25ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+7:5823:x1874598287114880:12345-0@lo:101: Request processed in 250us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756307.174339:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787756307.175044:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287114880:0@lo:101: 00010000:00010000:1.0:1787756307.175061:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 00000000c90826d3/0x178386880caaae2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae32 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756307.175071:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 00000000c90826d3/0x178386880caaae2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaae32 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756307.175087:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787756307.175102:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 00000000c90826d3/0x178386880caaae2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae32 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756307.175303:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 00000000c90826d3/0x178386880caaae2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae32 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756307.175312:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787756307.175316:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787756307.175322:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff98af903a6800 10000000:01000000:1.0:1787756307.175324:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787756307.175327:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787756307.175330:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787756307.175352:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 000000006c69c1a0/0x178386880caaae39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756307.175357:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 000000006c69c1a0/0x178386880caaae39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756307.175364:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 000000006c69c1a0/0x178386880caaae39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756307.175377:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115008:0@lo:101: 00000100:00100000:1.0:1787756307.175418:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756307.175488:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7762dff going to sleep for 11 seconds 00000100:00100000:2.0:1787756307.175578:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287115008 00000100:00100000:2.0:1787756307.175584:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287115008 00000100:00100000:3.0:1787756307.179373:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787756307.179393:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5ae02fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+7:5823:x1874598287115008:12345-0@lo:101: 00010000:00010000:3.0:1787756307.179412:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756307.179432:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db543b2c/0x178386880caaae40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaae39 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.179460:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db543b2c/0x178386880caaae40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaae39 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.179470:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db543b2c/0x178386880caaae40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaae39 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.179479:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db543b2c, rc 0) 00000100:00100000:3.0:1787756307.179625:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5ae02fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+8:5823:x1874598287115008:12345-0@lo:101: Request processed in 240us (4206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756307.179633:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787756307.183255:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115008:0@lo:101: 00010000:00010000:1.0:1787756307.183283:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 000000006c69c1a0/0x178386880caaae39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756307.183294:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 000000006c69c1a0/0x178386880caaae39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756307.183383:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115136:0@lo:501: 00000100:00100000:1.0:1787756307.183435:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756307.183546:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7762dff going to sleep for 11 seconds 00000100:00100000:3.0:1787756307.191424:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287115136 00000100:00100000:3.0:1787756307.191460:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287115136 00000100:00100000:2.0:1787756307.191638:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787756307.191648:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9f6f53c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+8:5823:x1874598287115136:12345-0@lo:501: 00000100:00100000:2.0:1787756307.191960:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9f6f53c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:5823:x1874598287115136:12345-0@lo:501: Request processed in 313us (8523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756307.191978:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787756307.192083:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115136:0@lo:501: 00000100:00100000:1.0:1787756307.192151:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115264:0@lo:503: 00000100:00100000:1.0:1787756307.192198:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756307.192249:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7762dff going to sleep for 11 seconds 00000100:00100000:2.0:1787756307.192365:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287115264 00000100:00100000:2.0:1787756307.192371:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287115264 00000100:00100000:2.0:1787756307.192405:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787756307.192412:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fefef617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:5823:x1874598287115264:12345-0@lo:503: 00000100:00100000:2.0:1787756307.192551:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fefef617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:5823:x1874598287115264:12345-0@lo:503: Request processed in 140us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756307.192557:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787756307.192804:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115264:0@lo:503: 00000100:00100000:3.0:1787756307.193405:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016611b4f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5865:1874598287115392:0@lo:502: 00000100:00100000:3.0:1787756307.193451:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756307.193483:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 000000009765e371 going to sleep for 11 seconds 00000100:00100000:2.0:1787756307.193622:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287115392 00000100:00100000:2.0:1787756307.193627:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287115392 00000100:00100000:2.0:1787756307.193661:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787756307.193668:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fca57b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:5865:x1874598287115392:12345-0@lo:502: 00000100:00100000:2.0:1787756307.193858:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fca57b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:5865:x1874598287115392:12345-0@lo:502: Request processed in 190us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756307.193865:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787756307.195594:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016611b4f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5865:1874598287115392:0@lo:502: 00000020:01000000:0.0:1787756307.195637:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787756307.195650:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756307.195653:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787756307.195657:0:5865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787756307.195660:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787756307.195688:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000026755c92) 00000020:00000080:0.0:1787756307.195706:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787756307.195713:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787756307.195821:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787756307.195872:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x178386880caaae4e 00000020:00000080:0.0:1787756307.196095:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787756307.196106:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787756307.196109:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756307.196245:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787756307.196251:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787756307.196256:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756307.196257:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787756307.196260:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787756307.196268:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000061fffef2) 00000020:00000080:0.0:1787756307.196278:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787756307.196283:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787756307.196284:0:5865:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787756307.196287:0:5865:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787756307.196293:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787756307.196336:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005a437d60 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787756307.196349:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000afbb6f4) 00000020:00000080:0.0:1787756307.196357:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787756307.196405:0:5865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787756307.196411:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x178386880caaae63 00000020:00000080:0.0:1787756307.196514:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787756307.196520:0:5865:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787756307.196524:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x178386880caaae6a 00080000:01000000:0.0:1787756307.196529:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787756307.196532:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x178386880caaae71 00080000:10000000:1.0:1787756307.200438:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787756307.200745:0:5865:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787756307.209773:0:5865:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1787756307.343604:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787756307.344465:0:5865:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787756307.347459:0:5865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787756307.347732:0:5865:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787756307.383527:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000002ab7b7bc) 00000020:00000080:0.0:1787756307.383560:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787756307.383624:0:5865:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787756307.383630:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x178386880caaae7f 00000020:00000080:1.0:1787756307.387151:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787756307.388704:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787756307.450806:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787756307.473124:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787756307.500610:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787756307.529227:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787756307.564948:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787756307.595709:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x178386880caaae86 00000020:00000080:3.0:1787756307.596127:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787756307.596137:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787756307.596143:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756307.596145:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787756307.596148:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787756307.596152:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756307.596154:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787756307.596156:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787756307.596158:0:5865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787756307.596160:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787756307.596163:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756307.596164:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787756307.596166:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787756307.596170:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756307.596171:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787756307.596175:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787756307.596207:0:5865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787756307.596255:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bdaabe00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5865:1874598287115520:0@lo:502: 00000100:00100000:3.0:1787756307.596327:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756307.596374:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000406b6b82 going to sleep for 11 seconds 00000100:00100000:0.0:1787756307.597049:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287115520 00000100:00100000:0.0:1787756307.597057:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287115520 00000100:00100000:0.0:1787756307.597102:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787756307.597110:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000377732b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:5865:x1874598287115520:12345-0@lo:502: 00000100:00100000:0.0:1787756307.597630:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000377732b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:5865:x1874598287115520:12345-0@lo:502: Request processed in 520us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756307.597639:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787756307.597955:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bdaabe00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5865:1874598287115520:0@lo:502: 00000020:01000000:3.0:1787756307.597996:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787756307.598003:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756307.598006:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787756307.598009:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787756307.598241:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787756307.598262:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787756307.598280:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 000000006c69c1a0/0x178386880caaae39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756307.598290:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 000000006c69c1a0/0x178386880caaae39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756307.598307:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98af903a6800 from 1 10000000:01000000:2.0:1787756307.598309:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787756307.598340:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756307.598348:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756307.598356:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756307.598372:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea678145 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115648:0@lo:101: 00000100:00100000:2.0:1787756307.598422:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756307.598460:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0205279 going to sleep for 11 seconds 00000100:00100000:0.0:1787756307.598615:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287115648 00000100:00100000:0.0:1787756307.598621:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287115648 00000100:00100000:0.0:1787756307.598661:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787756307.598668:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c731a0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:5823:x1874598287115648:12345-0@lo:101: 00010000:00010000:0.0:1787756307.598679:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756307.598690:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1cc75a8/0x178386880caaae94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaae8d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.598709:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1cc75a8/0x178386880caaae94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaae8d expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.598719:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1cc75a8/0x178386880caaae94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaae8d expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.598726:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1cc75a8, rc 0) 00000100:00100000:0.0:1787756307.598769:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c731a0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+10:5823:x1874598287115648:12345-0@lo:101: Request processed in 102us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756307.598776:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787756307.598878:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea678145 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115648:0@lo:101: 00010000:00010000:3.0:1787756307.598896:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.598904:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756307.599562:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bdaabe00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115776:0@lo:256: 00000100:00100000:3.0:1787756307.599605:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756307.599630:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000406b6b82 going to sleep for 11 seconds 00000100:00100000:2.0:1787756307.599811:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287115776 00000100:00100000:2.0:1787756307.599816:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287115776 00000100:00100000:2.0:1787756307.599878:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787756307.599885:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091a173fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+10:5823:x1874598287115776:12345-0@lo:256: 20000000:01000000:2.0:1787756307.599900:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787756307.599906:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787756307.599986:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091a173fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+10:5823:x1874598287115776:12345-0@lo:256: Request processed in 102us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756307.599994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787756307.600123:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bdaabe00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115776:0@lo:256: 10000000:01000000:3.0:1787756307.600920:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787756307.600992:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.601003:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787756307.601010:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98af903a6800 from 1 10000000:01000000:3.0:1787756307.601012:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787756307.601043:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.601050:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.601058:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756307.601074:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bdaabe00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115904:0@lo:101: 00000100:00100000:3.0:1787756307.601124:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756307.601170:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000406b6b82 going to sleep for 11 seconds 00000100:00100000:0.0:1787756307.601224:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287115904 00000100:00100000:0.0:1787756307.601230:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287115904 00000100:00100000:0.0:1787756307.601273:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787756307.601290:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019b484a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+10:5823:x1874598287115904:12345-0@lo:101: 00010000:00010000:0.0:1787756307.601300:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756307.601312:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000085fc75dd/0x178386880caaaea2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaae9b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.601329:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000085fc75dd/0x178386880caaaea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaae9b expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.601338:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000085fc75dd/0x178386880caaaea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaae9b expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.601346:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000085fc75dd, rc 0) 00000100:00100000:0.0:1787756307.601400:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019b484a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:5823:x1874598287115904:12345-0@lo:101: Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756307.601406:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787756307.601559:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bdaabe00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287115904:0@lo:101: 00010000:00010000:1.0:1787756307.601571:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756307.601578:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756307.601625:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287116032:0@lo:501: 00000100:00100000:1.0:1787756307.601649:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756307.601678:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c739a45d going to sleep for 11 seconds 00000100:00100000:3.0:1787756307.601786:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287116032 00000100:00100000:3.0:1787756307.601790:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287116032 00000100:00100000:3.0:1787756307.601819:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787756307.601825:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bc0a8b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:5823:x1874598287116032:12345-0@lo:501: 00000100:00100000:3.0:1787756307.602522:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bc0a8b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:5823:x1874598287116032:12345-0@lo:501: Request processed in 695us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756307.602530:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787756307.602638:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287116032:0@lo:501: 00000100:00100000:1.0:1787756307.602670:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287116160:0@lo:503: 00000100:00100000:1.0:1787756307.602708:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756307.602737:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c739a45d going to sleep for 11 seconds 00000100:00100000:0.0:1787756307.602800:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287116160 00000100:00100000:0.0:1787756307.602806:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287116160 00000100:00100000:0.0:1787756307.602862:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787756307.602870:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cb1f982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:5823:x1874598287116160:12345-0@lo:503: 00000040:00080000:0.0:1787756307.602906:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787756307.602939:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cb1f982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:5823:x1874598287116160:12345-0@lo:503: Request processed in 70us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756307.602946:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787756307.603031:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287116160:0@lo:503: 00000040:00080000:1.0:1787756307.603930:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787756307.604172:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787756307.604190:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787756307.604492:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.604503:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787756307.604556:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787756307.604558:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98af903a6800 10000000:01000000:0.0:1787756307.604561:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98af903a6800 10000000:01000000:0.0:1787756307.604564:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787756307.604569:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98af903a6800 from 1 10000000:01000000:0.0:1787756307.604571:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787756307.604600:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 000000003df093ea/0x178386880caaaea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.604607:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 000000003df093ea/0x178386880caaaea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.604615:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 000000003df093ea/0x178386880caaaea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756307.604630:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fdad1089 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287116288:0@lo:101: 00000100:00100000:0.0:1787756307.604677:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756307.604715:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f180c2df going to sleep for 11 seconds 00000100:00100000:3.0:1787756307.604770:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287116288 00000100:00100000:3.0:1787756307.604776:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287116288 00000100:00100000:3.0:1787756307.604816:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787756307.604823:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cd7a8d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:5823:x1874598287116288:12345-0@lo:101: 00010000:00010000:3.0:1787756307.604861:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756307.604872:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003cb92103/0x178386880caaaeb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaea9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.604891:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003cb92103/0x178386880caaaeb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaea9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.604901:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003cb92103/0x178386880caaaeb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaea9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.604909:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003cb92103, rc 0) 00000100:00100000:3.0:1787756307.604940:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cd7a8d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5823:x1874598287116288:12345-0@lo:101: Request processed in 118us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756307.604947:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787756307.605114:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fdad1089 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287116288:0@lo:101: 00010000:00010000:0.0:1787756307.605127:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 000000003df093ea/0x178386880caaaea9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.605145:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 000000003df093ea/0x178386880caaaea9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756307.605187:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fdad1089 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287116416:0@lo:501: 00000100:00100000:0.0:1787756307.605212:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756307.605245:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f180c2df going to sleep for 11 seconds 00000100:00100000:3.0:1787756307.605346:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287116416 00000100:00100000:3.0:1787756307.605356:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287116416 00000100:00100000:3.0:1787756307.605394:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787756307.605401:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000929bddaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5823:x1874598287116416:12345-0@lo:501: 00000100:00100000:3.0:1787756307.605626:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000929bddaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5823:x1874598287116416:12345-0@lo:501: Request processed in 226us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756307.605634:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787756307.605761:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fdad1089 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287116416:0@lo:501: 00000100:00100000:1.0:1787756307.605790:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287116544:0@lo:503: 00000100:00100000:1.0:1787756307.605828:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756307.605873:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 0000000027d4dbe2 going to sleep for 11 seconds 00000100:00100000:3.0:1787756307.605955:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287116544 00000100:00100000:3.0:1787756307.605960:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287116544 00000100:00100000:3.0:1787756307.606000:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787756307.606006:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1e28649 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5823:x1874598287116544:12345-0@lo:503: 00000100:00100000:3.0:1787756307.606295:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1e28649 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5823:x1874598287116544:12345-0@lo:503: Request processed in 289us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756307.606302:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787756307.606493:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287116544:0@lo:503: 00000100:00100000:0.0:1787756307.606863:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af680f73 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5870:1874598287116672:0@lo:502: 00000100:00100000:0.0:1787756307.606903:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756307.606929:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 0000000033c5a6a8 going to sleep for 11 seconds 00000100:00100000:3.0:1787756307.607038:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287116672 00000100:00100000:3.0:1787756307.607043:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287116672 00000100:00100000:3.0:1787756307.607075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787756307.607081:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e41ffdcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5870:x1874598287116672:12345-0@lo:502: 00000100:00100000:3.0:1787756307.607276:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e41ffdcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5870:x1874598287116672:12345-0@lo:502: Request processed in 194us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756307.607283:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787756307.607480:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af680f73 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5870:1874598287116672:0@lo:502: 00000020:01000004:0.0:1787756307.607531:0:5870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787756307.607551:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000467f76f9) 00000020:00000080:0.0:1787756307.607568:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787756307.607634:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005a437d60 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787756307.607637:0:5870:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005a437d60 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787756307.607639:0:5870:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005a437d60 4 00010000:00080000:0.0:1787756307.607663:0:5870:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fd1c977c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:0.0:1787756307.609974:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787756307.614150:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787756307.614217:0:5870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787756307.614231:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x178386880caaaebe 00000100:00080000:0.0:1787756307.614242:0:5870:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787756307.614246:0:5870:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000fd1c977c using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1787756307.614281:0:5870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000af680f73 x1874598287116800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787756307.614302:0:5870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787756307.614663:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af680f73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874598287116800:0@lo:38: 00000100:00100000:2.0:1787756307.614733:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756307.614896:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd0b685c pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5870:1874598287116928:0@lo:502: 00000100:00100000:2.0:1787756307.614939:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756307.614983:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287116928 00000100:00100000:2.0:1787756307.614989:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287116928 00000100:00100000:2.0:1787756307.615027:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787756307.615036:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a731d90b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5870:x1874598287116928:12345-0@lo:502: 00000100:00100000:2.0:1787756307.615257:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a731d90b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5870:x1874598287116928:12345-0@lo:502: Request processed in 222us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756307.615264:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787756307.615354:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f7c54a4 going to sleep for 11 seconds 00000100:00100000:2.0:1787756307.615374:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd0b685c pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5870:1874598287116928:0@lo:502: 00000040:00080000:2.0:1787756307.615413:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00010000:00010000:1.0:1787756307.615674:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787756307.615686:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787756307.615702:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787756307.615722:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 000000003df093ea/0x178386880caaaea9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756307.615732:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 000000003df093ea/0x178386880caaaea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787756307.615772:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787756307.615774:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787756307.615776:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787756307.615777:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787756307.615778:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787756307.615779:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787756307.615780:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787756307.615786:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787756307.615788:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787756307.615789:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787756307.615791:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787756307.615792:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787756307.615795:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787756307.615797:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787756307.615799:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787756307.615800:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787756307.615801:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787756307.615801:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787756307.615802:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787756307.615803:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787756307.615804:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787756307.615804:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787756307.615805:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787756307.615806:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787756307.615807:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787756307.615821:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787756307.615830:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287117056:0@lo:253: 00000100:00100000:1.0:1787756307.615886:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756307.615900:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c739a45d going to sleep for 11 seconds 00000100:00100000:0.0:1787756307.615997:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287116800 00000100:00100000:0.0:1787756307.616002:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287116800 00000100:00100000:0.0:1787756307.616026:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787756307.616030:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bdc02e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874598287116800:12345-0@lo:38: 00000100:00100000:0.0:1787756307.616073:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bdc02e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874598287116800:12345-0@lo:38: Request processed in 41us (1340us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787756307.616079:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787756307.616186:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787756307.616193:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000fd1c977c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787756307.616197:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787756307.616200:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af680f73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874598287116800:0@lo:38: 00000100:00100000:0.0:1787756307.616307:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287117056 00000100:00100000:0.0:1787756307.616312:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287117056 00000100:00100000:0.0:1787756307.616342:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787756307.616348:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f886ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5823:x1874598287117056:12345-0@lo:253: 20000000:01000000:0.0:1787756307.616375:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787756307.616399:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787756307.653773:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787756307.653792:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787756307.653983:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787756307.653988:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787756307.654007:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.654024:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b1cc75a8/0x178386880caaae94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaae8d expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.654032:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.654069:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b1cc75a8/0x178386880caaae94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaae8d expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.654083:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b1cc75a8/0x178386880caaae94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaae8d expref: 12 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756307.654095:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b247398 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874598287117184:0@lo:104: 00000100:00100000:0.0:1787756307.654166:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756307.654251:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c0dd8fc going to sleep for 11 seconds 00000100:00100000:2.0:1787756307.658434:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287117184 00000100:00100000:2.0:1787756307.658449:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287117184 00000100:00100000:2.0:1787756307.658502:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787756307.658510:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019d8e76f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5858:x1874598287117184:12345-0@lo:104: 00010000:00010000:2.0:1787756307.658527:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756307.658601:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787756307.658606:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019d8e76f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5858:x1874598287117184:12345-0@lo:104: Request processed in 97us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756307.658612:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787756307.658676:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787756307.658682:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.658689:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dfc39d96 already unused, calling callback (00000000d20121aa) 10000000:00010000:3.0:1787756307.658692:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.658717:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787756307.658723:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787756307.658728:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787756307.658767:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.658774:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787756307.658787:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.658793:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: 00000000dfc39d96/0x178386880caaae8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaae94 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.658820:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756307.658822:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756307.658823:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756307.659005:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006151ae9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287117312:0@lo:103: 00000100:00100000:0.0:1787756307.659046:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756307.659156:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b247398 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874598287117184:0@lo:104: 00010000:00010000:0.0:1787756307.659175:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756307.659330:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287117312 00000100:00100000:3.0:1787756307.659335:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287117312 00010000:00010000:3.0:1787756307.659355:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b1cc75a8/0x178386880caaae94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaae8d expref: 13 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756307.659394:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787756307.659401:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af680f73 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:3310:x1874598287117312:12345-0@lo:103: 00010000:00010000:3.0:1787756307.659411:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787756307.659415:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b1cc75a8/0x178386880caaae94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaae8d expref: 13 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.659432:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b1cc75a8/0x178386880caaae94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaae8d expref: 13 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.659445:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b1cc75a8/0x178386880caaae94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaae8d expref: 13 pid: 5835 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.659458:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.659464:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787756307.659477:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005489842s 00010000:00010000:3.0:1787756307.659481:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.659487:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.659492:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.659498:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.659503:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008d1d5270 already unused, calling callback (000000001c3fef05) 00010000:00010000:3.0:1787756307.659506:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.659512:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.659529:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756307.659538:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787756307.659570:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af680f73 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:3310:x1874598287117312:12345-0@lo:103: Request processed in 169us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756307.659577:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787756307.659691:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006151ae9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287117312:0@lo:103: 00010000:00010000:0.0:1787756307.659711:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.659717:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756307.659722:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008d1d5270/0x178386880caaaec5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756307.663531:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f886ebd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:5823:x1874598287117056:12345-0@lo:253: Request processed in 47176us (47638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756307.663560:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787756307.663641:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003086e90c pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5823:1874598287117056:0@lo:253: 10000000:01000000:1.0:1787756307.663656:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787756307.663658:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787756307.663660:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787756307.663661:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787756307.663663:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787756307.663664:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787756307.663666:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787756307.663667:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787756307.663668:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787756307.663669:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787756307.663670:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787756307.663672:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787756307.663673:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787756307.663688:0:5823:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787756307.669743:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787756307.670556:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787756307.670788:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787756307.673086:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787756307.674373:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787756307.674578:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787756307.675567:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787756307.675746:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787756307.676010:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787756307.676474:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787756307.676649:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787756307.676980:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787756307.716713:0:5823:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787756307.746111:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787756307.746201:0:5875:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787756307.746205:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787756307.746528:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787756307.750304:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787756307.750615:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787756307.751231:0:5823:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787756307.751240:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787756307.751492:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787756307.754673:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787756307.755471:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787756307.755507:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787756307.755737:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787756307.755936:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787756307.757150:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787756307.757288:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787756307.757436:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787756307.757589:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787756307.757733:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787756307.757899:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787756307.760684:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787756307.761718:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787756307.761950:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787756307.762119:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787756307.763014:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787756307.763198:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787756307.763363:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787756307.763621:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787756307.763773:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787756307.764248:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787756307.764589:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787756307.764726:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787756307.767688:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787756307.769652:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787756307.770681:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787756307.772096:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787756307.772291:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787756307.772515:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787756307.772677:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787756307.772806:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787756307.773005:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787756307.773141:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787756307.773304:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787756307.773956:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787756307.774135:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787756307.774263:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787756307.778063:0:5823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787756307.818083:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787756307.875858:0:5823:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787756307.875895:0:5823:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaeaa41cc3988 00100000:10000000:1.0:1787756307.875904:0:5823:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787756307.877583:0:5823:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787756307.877597:0:5823:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787756307.877618:0:5823:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787756307.877633:0:5823:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787756307.878028:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787756307.878746:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787756307.878752:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787756308.633133:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756309.656678:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756310.686631:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756311.707319:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787756312.328302:0:6119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787756312.730964:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787756313.114250:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787756313.114260:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787756313.114263:0:8:0:(import.c:65:import_set_state_nolock()) 00000000fd1c977c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787756313.114284:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000fd1c977c using connection 192.168.203.121@tcp/0@lo 00000100:00100000:3.0:1787756313.114308:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dffc4bf4 x1874598287117568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787756313.114313:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004c087ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287117440:0@lo:400: 00000100:00100000:0.0:1787756313.114380:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756313.114560:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287117440 00000100:00100000:3.0:1787756313.114566:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287117440 00000100:00100000:3.0:1787756313.114880:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787756313.114891:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3c3855d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:3311:x1874598287117440:12345-0@lo:400: 00000100:00100000:3.0:1787756313.115311:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3c3855d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:3311:x1874598287117440:12345-0@lo:400: Request processed in 422us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756313.115321:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787756313.115374:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004c087ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287117440:0@lo:400: 00000100:00100000:3.0:1787756313.116218:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dffc4bf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874598287117568:0@lo:38: 00000100:00100000:3.0:1787756313.116280:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756313.118500:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287117568 00000100:00100000:1.0:1787756313.118520:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287117568 00000100:00100000:1.0:1787756313.118576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787756313.118582:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004c087ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1874598287117568:12345-0@lo:38: 00010000:00080000:1.0:1787756313.118608:0:5844:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1787756313.118641:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x178386880caaaecc 00000004:00100000:1.0:1787756313.118692:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787756313.118804:0:5844:0:(import.c:65:import_set_state_nolock()) 00000000292dd53a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787756313.118900:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004c087ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874598287117568:12345-0@lo:38: Request processed in 317us (2621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756313.118908:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787756313.119963:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dffc4bf4 x1874598287117568/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787756323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787756313.119980:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787756313.119987:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787756313.119991:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787756313.119993:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000fd1c977c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787756313.119999:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dffc4bf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874598287117568:0@lo:38: 00010000:00010000:0.0:1787756313.755521:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787756314.648318:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787756314.648328:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98af903a6800 from 3 10000000:01000000:3.0:1787756314.648332:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787756314.648376:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 0000000055f6fe60/0x178386880caaaed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756314.648387:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 0000000055f6fe60/0x178386880caaaed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756314.648397:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 0000000055f6fe60/0x178386880caaaed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756314.648420:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004548bc69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287117696:0@lo:101: 00000100:00100000:3.0:1787756314.648485:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756314.648559:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c54e5b89 going to sleep for 11 seconds 00000100:00100000:2.0:1787756314.648659:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287117696 00000100:00100000:2.0:1787756314.648666:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287117696 00000100:00100000:2.0:1787756314.648712:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787756314.648720:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016a6fb7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:5839:x1874598287117696:12345-0@lo:101: 00010000:00010000:2.0:1787756314.648731:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756314.648743:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000004dbec3e/0x178386880caaaeda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaed3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756314.648762:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004dbec3e/0x178386880caaaeda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaed3 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756314.648770:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000004dbec3e/0x178386880caaaeda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaed3 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756314.648777:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000004dbec3e, rc 0) 00000100:00100000:2.0:1787756314.648820:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016a6fb7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5839:x1874598287117696:12345-0@lo:101: Request processed in 101us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756314.648827:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787756314.648930:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004548bc69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287117696:0@lo:101: 00010000:00010000:0.0:1787756314.648942:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 0000000055f6fe60/0x178386880caaaed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756314.648949:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 0000000055f6fe60/0x178386880caaaed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756314.648993:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013da55a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287117824:0@lo:256: 00000100:00100000:0.0:1787756314.649021:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756314.649044:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 0000000073d6ab2a going to sleep for 11 seconds 00000100:00100000:2.0:1787756314.649408:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287117824 00000100:00100000:2.0:1787756314.649419:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287117824 00000100:00100000:2.0:1787756314.649449:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787756314.649455:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be4a6d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5839:x1874598287117824:12345-0@lo:256: 20000000:01000000:2.0:1787756314.649468:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787756314.649482:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787756314.649484:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787756314.649565:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be4a6d0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5839:x1874598287117824:12345-0@lo:256: Request processed in 109us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756314.649572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787756314.649682:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013da55a8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287117824:0@lo:256: 10000000:01000000:0.0:1787756314.649721:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787756314.649727:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: 0000000055f6fe60/0x178386880caaaed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756314.649735:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: 0000000055f6fe60/0x178386880caaaed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756314.776336:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756315.801072:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756316.824273:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787756317.023672:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbf12f450 20000000:00000080:0.0:1787756317.023693:0:6320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98af85b3d800 uarg=0000000000000000 20000000:01000000:0.0:1787756317.023740:0:6320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787756317.023748:0:6320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787756317.023753:0:6320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787756317.024493:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787756317.024511:0:6320:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787756317.033702:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787756317.033969:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787756317.034018:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787756317.034057:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787756317.034197:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787756317.034225:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756317.034242:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000085fc75dd/0x178386880caaaea2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaae9b expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756317.034249:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756317.034287:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000085fc75dd/0x178386880caaaea2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaae9b expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756317.034303:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000085fc75dd/0x178386880caaaea2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaae9b expref: 11 pid: 5837 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756317.034316:0:6320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d00422dd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1874598287117952:0@lo:104: 00000100:00100000:1.0:1787756317.034384:0:6320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756317.034440:0:6320:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029f8adb8 going to sleep for 11 seconds 00000100:00100000:3.0:1787756317.035240:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287117952 00000100:00100000:3.0:1787756317.035257:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287117952 00000100:00100000:3.0:1787756317.035379:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787756317.035390:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a836f774 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:6320:x1874598287117952:12345-0@lo:104: 00010000:00010000:3.0:1787756317.035410:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756317.035534:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787756317.035541:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a836f774 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:6320:x1874598287117952:12345-0@lo:104: Request processed in 154us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756317.035550:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787756317.035626:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787756317.035634:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.035643:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a11d7100 already unused, calling callback (00000000d20121aa) 10000000:00010000:0.0:1787756317.035646:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.035655:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787756317.035662:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787756317.035667:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787756317.035715:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.035722:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787756317.035745:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.035751:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: 00000000a11d7100/0x178386880caaae9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaea2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.035775:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756317.035795:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756317.035797:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756317.035825:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041cc9f8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287118080:0@lo:103: 00000100:00100000:0.0:1787756317.035911:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756317.035966:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287118080 00000100:00100000:0.0:1787756317.035969:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287118080 00010000:00010000:0.0:1787756317.035992:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000085fc75dd/0x178386880caaaea2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaae9b expref: 12 pid: 5837 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756317.036030:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787756317.036035:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b9cb2f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:3312:x1874598287118080:12345-0@lo:103: 00010000:00010000:0.0:1787756317.036047:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756317.036050:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000085fc75dd/0x178386880caaaea2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaae9b expref: 12 pid: 5837 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.036060:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000085fc75dd/0x178386880caaaea2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaae9b expref: 12 pid: 5837 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.036079:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.036086:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.036110:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.036116:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.036121:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.036133:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.036138:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002a9b70ab already unused, calling callback (000000001c3fef05) 00010000:00010000:0.0:1787756317.036141:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.036148:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.036156:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756317.036166:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756317.036199:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b9cb2f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:3312:x1874598287118080:12345-0@lo:103: Request processed in 163us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756317.036205:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787756317.036256:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041cc9f8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287118080:0@lo:103: 00010000:00010000:1.0:1787756317.036481:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000085fc75dd/0x178386880caaaea2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaae9b expref: 11 pid: 5837 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756317.036494:0:6320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d00422dd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1874598287117952:0@lo:104: 00010000:00010000:1.0:1787756317.036511:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756317.036518:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756317.036534:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756317.036539:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002a9b70ab/0x178386880caaaee1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756317.855148:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756318.236129:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000932d45bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287118336:0@lo:400: 00000100:00100000:2.0:1787756318.236201:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756318.236256:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787756318.236263:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd0b685c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287118208:0@lo:400: 00000100:00100000:2.0:1787756318.236290:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756318.236326:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287118336 00000100:00100000:2.0:1787756318.236333:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287118336 00000100:00100000:2.0:1787756318.236374:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787756318.236382:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000560bda12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287118336:12345-0@lo:400: 00000100:00100000:2.0:1787756318.236427:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000560bda12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287118336:12345-0@lo:400: Request processed in 47us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756318.236434:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787756318.236458:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287118208 00000100:00100000:2.0:1787756318.236461:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287118208 00000100:00100000:2.0:1787756318.236480:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787756318.236485:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e3cfe0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:3310:x1874598287118208:12345-0@lo:400: 00000100:00100000:2.0:1787756318.236508:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e3cfe0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:3310:x1874598287118208:12345-0@lo:400: Request processed in 23us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756318.236524:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787756318.236564:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd0b685c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287118208:0@lo:400: 00010000:00080000:2.0:1787756318.236577:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000932d45bb x1874598287118336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756318.236587:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000932d45bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287118336:0@lo:400: 00010000:00010000:3.0:1787756318.874956:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756319.896198:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756320.919962:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756321.945210:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787756322.331646:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787756322.331654:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98af903a6800 from 1 10000000:01000000:1.0:1787756322.331659:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787756322.331701:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: 000000002a9b70ab/0x178386880caaaee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756322.331711:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: 000000002a9b70ab/0x178386880caaaee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756322.331722:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: 000000002a9b70ab/0x178386880caaaee8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756322.331745:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f94f4fea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287118464:0@lo:101: 00000100:00100000:1.0:1787756322.331809:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756322.331951:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000005938d0bc going to sleep for 11 seconds 00000100:00100000:2.0:1787756322.332151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287118464 00000100:00100000:2.0:1787756322.332158:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287118464 00000100:00100000:2.0:1787756322.332206:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787756322.332214:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000077007ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:5839:x1874598287118464:12345-0@lo:101: 00010000:00010000:2.0:1787756322.332227:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756322.332239:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006922dfba/0x178386880caaaeef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756322.332259:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006922dfba/0x178386880caaaeef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaee8 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756322.332270:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006922dfba/0x178386880caaaeef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaee8 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756322.332278:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006922dfba, rc 0) 00000100:00100000:2.0:1787756322.332325:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000077007ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5839:x1874598287118464:12345-0@lo:101: Request processed in 112us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756322.332332:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787756322.332720:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f94f4fea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287118464:0@lo:101: 00010000:00010000:1.0:1787756322.332735:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: 000000002a9b70ab/0x178386880caaaee8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756322.332743:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: 000000002a9b70ab/0x178386880caaaee8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756322.332800:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f94f4fea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287118592:0@lo:501: 00000100:00100000:1.0:1787756322.332881:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756322.332904:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000005938d0bc going to sleep for 11 seconds 00000100:00100000:2.0:1787756322.332964:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287118592 00000100:00100000:2.0:1787756322.332974:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287118592 00000100:00100000:2.0:1787756322.332999:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787756322.333004:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000371a6784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5839:x1874598287118592:12345-0@lo:501: 00000100:00100000:2.0:1787756322.343040:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000371a6784 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5839:x1874598287118592:12345-0@lo:501: Request processed in 10028us (10152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756322.343055:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787756322.345422:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f94f4fea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287118592:0@lo:501: 00000100:00100000:1.0:1787756322.345491:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f94f4fea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287118720:0@lo:503: 00000100:00100000:1.0:1787756322.345566:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756322.345607:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000005938d0bc going to sleep for 11 seconds 00000100:00100000:2.0:1787756322.346890:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287118720 00000100:00100000:2.0:1787756322.346899:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287118720 00000100:00100000:2.0:1787756322.346945:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787756322.346955:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ebc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5839:x1874598287118720:12345-0@lo:503: 00000100:00100000:2.0:1787756322.347248:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ebc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5839:x1874598287118720:12345-0@lo:503: Request processed in 295us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756322.347256:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787756322.347304:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f94f4fea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287118720:0@lo:503: 00000100:00100000:0.0:1787756322.349662:0:6663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007444b901 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6663:1874598287118848:0@lo:502: 00000100:00100000:0.0:1787756322.349731:0:6663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756322.349770:0:6663:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1679e29 going to sleep for 11 seconds 00000100:00100000:2.0:1787756322.349946:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287118848 00000100:00100000:2.0:1787756322.349952:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287118848 00000100:00100000:2.0:1787756322.349985:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787756322.349993:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042fb6684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6663:x1874598287118848:12345-0@lo:502: 00000100:00100000:2.0:1787756322.350353:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042fb6684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6663:x1874598287118848:12345-0@lo:502: Request processed in 360us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756322.350361:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787756322.357906:0:6663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007444b901 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6663:1874598287118848:0@lo:502: 00000020:01000000:1.0:1787756322.358096:0:6663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787756322.358107:0:6663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756322.358110:0:6663:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787756322.358116:0:6663:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98af903a6800 00000020:00000080:1.0:1787756322.358120:0:6663:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787756322.358188:0:6663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6663:1874598287118976:0@lo:502: 00000100:00100000:1.0:1787756322.358259:0:6663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756322.358319:0:6663:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afb3600300 going to sleep for 11 seconds 00000100:00100000:2.0:1787756322.358386:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287118976 00000100:00100000:2.0:1787756322.358393:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287118976 00000100:00100000:2.0:1787756322.358444:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787756322.358452:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6663:x1874598287118976:12345-0@lo:502: 00000100:00100000:2.0:1787756322.358682:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6663:x1874598287118976:12345-0@lo:502: Request processed in 230us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756322.358699:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787756322.358898:0:6663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6663:1874598287118976:0@lo:502: 00000020:01000000:1.0:1787756322.358921:0:6663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787756322.358926:0:6663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756322.358928:0:6663:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787756322.358931:0:6663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787756322.363507:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787756322.363540:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787756322.363553:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc21cf200/0x178386880caaaee8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756322.363566:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc21cf200/0x178386880caaaee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756322.968940:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787756323.027615:0:6688:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787756323.027619:0:6688:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787756323.027829:0:6688:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98afb3fb3800 00000020:01000004:3.0:1787756323.027884:0:6688:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787756323.027896:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787756323.027908:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff98af87ff4ed8) 00000020:00000080:3.0:1787756323.027923:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787756323.038490:0:6688:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787756323.038694:0:6688:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787756323.054495:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787756323.058616:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787756323.058649:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787756323.058700:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787756323.058721:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787756323.059301:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787756323.059311:0:6688:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787756323.059324:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x178386880caaaefd 00000020:01000004:3.0:1787756323.059333:0:6688:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787756323.059351:0:6688:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.121@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787756323.059354:0:6688:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787756323.059359:0:6688:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787756323.059363:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787756323.059380:0:6688:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff98af85c8ced8) 00000020:00000080:3.0:1787756323.059389:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787756323.060462:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787756323.060601:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787756323.060606:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787756323.065094:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787756323.065107:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787756323.066964:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787756323.066974:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787756323.068371:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787756323.068536:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787756323.068541:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787756323.069596:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787756323.069604:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787756323.086573:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787756323.087192:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787756323.087200:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787756323.089347:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787756323.089361:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787756323.090704:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787756323.090715:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787756323.093310:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787756323.093480:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787756323.093485:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787756323.094104:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787756323.094111:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787756323.132499:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787756323.132724:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787756323.132732:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787756323.134497:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787756323.134511:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787756323.134955:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787756323.134975:0:6688:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787756323.134981:0:6688:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787756323.150000:0:6688:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787756323.150104:0:6688:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.121@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787756323.150108:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787756323.150113:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787756323.150114:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787756323.150115:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787756323.150116:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787756323.150117:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787756323.150119:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787756323.150120:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787756323.150121:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787756323.150123:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787756323.150124:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787756323.150127:0:6688:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787756323.150128:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787756323.150129:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787756323.150130:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787756323.150131:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787756323.150132:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787756323.150133:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787756323.150133:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787756323.150134:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787756323.150135:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787756323.150136:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787756323.150137:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787756323.150160:0:6688:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787756323.150179:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287119104:0@lo:253: 00000100:00100000:3.0:1787756323.150266:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.150379:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af8692f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756323.150479:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287119104 00000100:00100000:2.0:1787756323.150486:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287119104 00000100:00100000:2.0:1787756323.150568:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787756323.150577:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287119104:12345-0@lo:253: 20000000:01000000:2.0:1787756323.150605:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787756323.150609:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787756323.150614:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787756323.150618:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787756323.151527:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787756323.151743:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787756323.151761:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787756323.151796:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787756323.151802:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787756323.151825:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787756323.151931:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787756323.152384:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787756323.152402:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:2.0:1787756323.152404:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:2.0:1787756323.152431:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787756323.152437:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787756323.152472:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787756323.152478:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:2.0:1787756323.152518:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787756323.152526:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787756323.152550:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787756323.152591:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787756323.153496:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787756323.153516:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:2.0:1787756323.153518:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:2.0:1787756323.153554:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787756323.153562:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787756323.153593:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787756323.153600:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:2.0:1787756323.153645:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787756323.153653:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787756323.153680:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787756323.153710:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787756323.153723:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1787756323.153725:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1787756323.153731:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787756323.153732:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787756323.153740:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787756323.153753:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787756323.153755:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787756323.153785:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787756323.153787:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787756323.154518:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787756323.154576:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787756323.154638:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787756323.155099:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787756323.155143:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787756323.155201:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787756323.155215:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787756323.155217:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787756323.155569:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787756323.155762:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787756323.155799:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787756323.156198:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787756323.156212:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787756323.156214:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787756323.156606:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787756323.156655:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787756323.156699:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787756323.156972:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787756323.157019:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787756323.157118:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:2.0:1787756323.157135:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787756323.157153:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.157171:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af80031400/0x178386880caaae24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaae1d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.157179:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af84da7200/0x178386880caaae40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaae39 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.157186:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af84da7800/0x178386880caaaeb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaea9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.157193:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.157242:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af84da7800/0x178386880caaaeb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaaea9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.157258:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af84da7800/0x178386880caaaeb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaaea9 expref: 12 pid: 5835 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756323.157272:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aaa940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874598287119232:0@lo:104: 00000100:00100000:2.0:1787756323.157331:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787756323.157432:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af84da7200/0x178386880caaae40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaae39 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.157440:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af84da7200/0x178386880caaae40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaae39 expref: 12 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756323.157448:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aaa1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874598287119360:0@lo:104: 00000100:00100000:2.0:1787756323.157480:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787756323.157613:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af80031400/0x178386880caaae24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaae1d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.157622:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af80031400/0x178386880caaae24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaae1d expref: 12 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756323.157629:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874598287119488:0@lo:104: 00000100:00100000:2.0:1787756323.157649:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756323.157704:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287119232 00000100:00100000:0.0:1787756323.157710:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287119232 00000100:00100000:0.0:1787756323.157744:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287119360 00000100:00100000:0.0:1787756323.157747:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287119360 00000100:00100000:0.0:1787756323.157759:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787756323.157768:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:5836:x1874598287119232:12345-0@lo:104: 00010000:00010000:0.0:1787756323.157780:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98af80030a00/0x178386880caaaea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.157867:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787756323.157873:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:5836:x1874598287119232:12345-0@lo:104: Request processed in 106us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756323.157880:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787756323.157896:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787756323.157902:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5836:x1874598287119360:12345-0@lo:104: 00010000:00010000:0.0:1787756323.157909:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaae39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.157947:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787756323.157952:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aaad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5836:x1874598287119360:12345-0@lo:104: Request processed in 52us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756323.157958:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787756323.158011:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787756323.158019:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af80030a00/0x178386880caaaea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158097:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af80030a00 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:1.0:1787756323.158100:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af80030a00/0x178386880caaaea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158108:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af80030a00/0x178386880caaaea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787756323.158121:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af80030a00/0x178386880caaaea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756323.158126:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787756323.158157:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af80030a00/0x178386880caaaea9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158164:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787756323.158185:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af80030a00/0x178386880caaaea9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158192:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af80030a00/0x178386880caaaea9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaeb0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158204:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787756323.158207:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaae39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158212:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc21cf800 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:1.0:1787756323.158215:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaae39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158220:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaae39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787756323.158225:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaae39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756323.158230:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787756323.158248:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaae39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158252:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787756323.158257:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaae39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158262:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaae39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaae40 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158271:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756323.158272:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756323.158274:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756323.158292:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287119744:0@lo:103: 00000100:00100000:1.0:1787756323.158323:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756323.158353:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787756323.158359:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287119616:0@lo:103: 00000100:00100000:1.0:1787756323.158377:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756323.158406:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287119744 00000100:00100000:1.0:1787756323.158410:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287119744 00010000:00010000:1.0:1787756323.158430:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af84da7200/0x178386880caaae40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaae39 expref: 13 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756323.158448:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287119616 00000100:00100000:1.0:1787756323.158450:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287119616 00010000:00010000:1.0:1787756323.158470:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af84da7800/0x178386880caaaeb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaea9 expref: 14 pid: 5835 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756323.158482:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787756323.158487:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:3312:x1874598287119744:12345-0@lo:103: 00010000:00010000:1.0:1787756323.158501:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787756323.158506:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af84da7200/0x178386880caaae40 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaae39 expref: 14 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158514:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af84da7200/0x178386880caaae40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaae39 expref: 14 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158528:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787756323.158555:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:3312:x1874598287119744:12345-0@lo:103: Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756323.158561:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787756323.158573:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787756323.158578:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99befc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:3312:x1874598287119616:12345-0@lo:103: 00010000:00010000:1.0:1787756323.158585:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787756323.158588:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af84da7800/0x178386880caaaeb0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaea9 expref: 13 pid: 5835 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158596:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af84da7800/0x178386880caaaeb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaaea9 expref: 13 pid: 5835 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.158604:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787756323.158620:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99befc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:3312:x1874598287119616:12345-0@lo:103: Request processed in 43us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756323.158625:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787756323.158658:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287119616:0@lo:103: 00000100:00100000:1.0:1787756323.158664:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287119744:0@lo:103: 00010000:00010000:2.0:1787756323.158803:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756323.158811:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af85d0bc00 going to sleep for 11 seconds 00010000:00010000:2.0:1787756323.158823:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da7800/0x178386880caaaeb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaaea9 expref: 12 pid: 5835 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756323.158870:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aaa940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874598287119232:0@lo:104: 00010000:00010000:2.0:1787756323.158882:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da7200/0x178386880caaae40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaae39 expref: 11 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756323.158889:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aaa1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874598287119360:0@lo:104: 00000100:00100000:0.0:1787756323.158943:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287119488 00000100:00100000:0.0:1787756323.158947:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287119488 00000100:00100000:0.0:1787756323.158965:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787756323.158970:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5836:x1874598287119488:12345-0@lo:104: 00010000:00010000:0.0:1787756323.158980:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaae1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756323.159105:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5836:1874598287119488:0@lo:104: 00010000:00010000:2.0:1787756323.159123:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.159161:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787756323.159167:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5836:x1874598287119488:12345-0@lo:104: Request processed in 196us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756323.159173:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787756323.159214:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787756323.159218:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaae1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.159225:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2044000 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756323.159228:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaae1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.159235:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaae1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756323.159242:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaae1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756323.159248:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787756323.159277:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaae1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.159284:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787756323.159304:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaae1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.159311:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaae1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaae24 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.159326:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756323.159328:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756323.159329:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756323.159340:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287119872:0@lo:103: 00000100:00100000:2.0:1787756323.159366:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756323.159459:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287119872 00000100:00100000:1.0:1787756323.159463:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287119872 00010000:00010000:1.0:1787756323.159485:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af80031400/0x178386880caaae24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaae1d expref: 11 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756323.159510:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787756323.159516:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:3309:x1874598287119872:12345-0@lo:103: 00010000:00010000:1.0:1787756323.159523:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787756323.159526:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af80031400/0x178386880caaae24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaae1d expref: 11 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159535:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af80031400/0x178386880caaae24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaae1d expref: 11 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159547:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af80031400/0x178386880caaae24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaae1d expref: 11 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159559:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159567:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159581:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159587:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159593:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159599:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159615:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2045200 already unused, calling callback (ffffffffc162d530) 00010000:00010000:1.0:1787756323.159618:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159625:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159637:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159646:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787756323.159671:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+10:3309:x1874598287119872:12345-0@lo:103: Request processed in 156us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756323.159677:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787756323.159698:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287119872:0@lo:103: 00010000:00010000:1.0:1787756323.159710:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159717:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.159722:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afc2045200/0x178386880caaaf0b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787756323.159732:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787756323.190677:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:6688:x1874598287119104:12345-0@lo:253: Request processed in 40092us (40401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756323.190692:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787756323.190805:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287119104:0@lo:253: 10000000:01000000:0.0:1787756323.190820:0:6688:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787756323.190823:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787756323.190825:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787756323.190826:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787756323.190828:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787756323.190847:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787756323.190848:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787756323.190850:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787756323.190851:0:6688:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787756323.190853:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787756323.190854:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787756323.190884:0:6688:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98afb3fb3800 from lustre-OST0000 10000000:01000000:0.0:1787756323.190907:0:6688:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787756323.190909:0:6688:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787756323.190916:0:6688:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98af87ff1a48 local copy 10000000:01000000:0.0:1787756323.190920:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787756323.190955:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.190965:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.190974:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756323.190992:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120000:0@lo:101: 00000100:00100000:0.0:1787756323.191055:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756323.191115:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9029d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787756323.191253:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287120000 00000100:00100000:2.0:1787756323.191260:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287120000 00000100:00100000:2.0:1787756323.191304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787756323.191313:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:6688:x1874598287120000:12345-0@lo:101: 00010000:00010000:2.0:1787756323.191325:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756323.191337:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98afc2044000/0x178386880caaaf19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaf12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.191361:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afc2044000/0x178386880caaaf19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaf12 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.191371:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98afc2044000/0x178386880caaaf19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf12 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.191381:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2044000, rc 0) 00000100:00100000:2.0:1787756323.191422:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+10:6688:x1874598287120000:12345-0@lo:101: Request processed in 110us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756323.191428:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787756323.191506:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120000:0@lo:101: 00010000:00010000:3.0:1787756323.191520:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.191528:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756323.191640:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120128:0@lo:501: 00000100:00100000:3.0:1787756323.191666:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.191690:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787756323.191742:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287120128 00000100:00100000:2.0:1787756323.191753:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287120128 00000100:00100000:2.0:1787756323.191783:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787756323.191789:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+10:6688:x1874598287120128:12345-0@lo:501: 00000100:00100000:2.0:1787756323.192001:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+10:6688:x1874598287120128:12345-0@lo:501: Request processed in 211us (333us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787756323.192007:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787756323.192128:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120128:0@lo:501: 10000000:01000000:3.0:1787756323.192141:0:6688:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787756323.192163:0:6688:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787756323.192168:0:6688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.192177:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.192183:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.192290:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787756323.192309:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98afb3fb3800 10000000:01000000:3.0:1787756323.192313:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787756323.192317:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff98af87ff1a48 10000000:01000000:3.0:1787756323.192319:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787756323.192323:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff98af87ff1a48 from 1 10000000:01000000:3.0:1787756323.192325:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787756323.192342:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af84da7e00/0x178386880caaaf20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.192349:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af84da7e00/0x178386880caaaf20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.192368:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af84da7e00/0x178386880caaaf20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756323.192380:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120256:0@lo:101: 00000100:00100000:3.0:1787756323.192407:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.192436:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787756323.192481:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287120256 00000100:00100000:0.0:1787756323.192486:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287120256 00000100:00100000:0.0:1787756323.192512:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787756323.192517:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+10:6688:x1874598287120256:12345-0@lo:101: 00010000:00010000:0.0:1787756323.192524:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756323.192532:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af80031600/0x178386880caaaf27 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaf20 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.192548:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af80031600/0x178386880caaaf27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaf20 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.192556:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af80031600/0x178386880caaaf27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf20 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.192563:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af80031600, rc 0) 00000100:00100000:0.0:1787756323.192593:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:6688:x1874598287120256:12345-0@lo:101: Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756323.192599:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787756323.192667:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120256:0@lo:101: 00010000:00010000:3.0:1787756323.192677:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af84da7e00/0x178386880caaaf20 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf27 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.192684:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af84da7e00/0x178386880caaaf20 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaaf27 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787756323.192698:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787756323.192743:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af84da7e00/0x178386880caaaf20 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf27 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.192750:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af84da7e00/0x178386880caaaf20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf27 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787756323.192756:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787756323.192760:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787756323.192763:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787756323.192765:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787756323.192777:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.192783:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.192795:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756323.192805:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120384:0@lo:101: 00000100:00100000:3.0:1787756323.192829:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.192879:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7ac00 going to sleep for 11 seconds 00010000:00010000:2.0:1787756323.192986:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787756323.192993:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.193001:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af80031e00 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756323.193004:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.193012:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756323.193019:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756323.193085:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787756323.193105:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.193111:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787756323.193153:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287120512:0@lo:103: 00000100:00100000:3.0:1787756323.193183:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756323.193238:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287120512 00000100:00100000:1.0:1787756323.193242:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287120512 00000100:00100000:1.0:1787756323.193271:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787756323.193277:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bf5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:3310:x1874598287120512:12345-0@lo:103: 00010000:00010000:1.0:1787756323.193292:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787756323.193302:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afc2044000/0x178386880caaaf19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x178386880caaaf12 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.193316:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756323.193369:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287120384 00000100:00100000:0.0:1787756323.193372:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287120384 00000100:00100000:0.0:1787756323.193390:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787756323.193395:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:6688:x1874598287120384:12345-0@lo:101: 00010000:00010000:0.0:1787756323.193401:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756323.193410:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af80030c00/0x178386880caaaf35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaf2e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.193421:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af80030c00/0x178386880caaaf35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaf2e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.193434:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af80030c00/0x178386880caaaf35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf2e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.193440:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af80030c00, rc 0) 00000100:00100000:0.0:1787756323.193468:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287120384:12345-0@lo:101: Request processed in 72us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756323.193473:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1787756323.193526:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.193533:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af80031e00/0x178386880caaaf12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x178386880caaaf19 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.193554:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756323.193556:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756323.193557:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756323.193652:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bf5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:3310:x1874598287120512:12345-0@lo:103: Request processed in 375us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756323.193658:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787756323.193699:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287120512:0@lo:103: 00000100:00100000:3.0:1787756323.193721:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120384:0@lo:101: 00010000:00010000:3.0:1787756323.193731:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.193738:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756323.193804:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120640:0@lo:501: 00000100:00100000:3.0:1787756323.193830:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.194146:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787756323.194180:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287120640 00000100:00100000:2.0:1787756323.194184:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287120640 00000100:00100000:2.0:1787756323.194241:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787756323.194248:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:6688:x1874598287120640:12345-0@lo:501: 00000100:00100000:2.0:1787756323.194483:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:6688:x1874598287120640:12345-0@lo:501: Request processed in 235us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756323.194489:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787756323.194552:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120640:0@lo:501: 00000100:00100000:3.0:1787756323.194579:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120768:0@lo:503: 00000100:00100000:3.0:1787756323.194617:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.194665:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787756323.194696:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287120768 00000100:00100000:2.0:1787756323.194699:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287120768 00000100:00100000:2.0:1787756323.194725:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787756323.194730:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:6688:x1874598287120768:12345-0@lo:503: 00000100:00100000:2.0:1787756323.194893:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:6688:x1874598287120768:12345-0@lo:503: Request processed in 161us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756323.194900:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787756323.195003:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120768:0@lo:503: 00000040:00080000:1.0:1787756323.195306:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787756323.195358:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120896:0@lo:502: 00000100:00100000:1.0:1787756323.195391:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756323.195417:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9e0ebcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756323.195513:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287120896 00000100:00100000:2.0:1787756323.195517:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287120896 00000100:00100000:2.0:1787756323.195583:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787756323.195590:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:6688:x1874598287120896:12345-0@lo:502: 00000100:00100000:2.0:1787756323.195715:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:6688:x1874598287120896:12345-0@lo:502: Request processed in 125us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756323.195721:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787756323.195777:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287120896:0@lo:502: 00000040:00080000:1.0:1787756323.196008:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787756323.196063:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787756323.196090:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787756323.196125:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787756323.196152:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787756323.196178:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787756323.196200:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121024:0@lo:502: 00000100:00100000:1.0:1787756323.196232:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756323.196415:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9e0ebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756323.196522:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287121024 00000100:00100000:3.0:1787756323.196527:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287121024 00000100:00100000:3.0:1787756323.196559:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787756323.196565:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:6688:x1874598287121024:12345-0@lo:502: 00000100:00100000:3.0:1787756323.196722:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:6688:x1874598287121024:12345-0@lo:502: Request processed in 156us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756323.196728:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787756323.196786:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121024:0@lo:502: 00000040:00080000:1.0:1787756323.196888:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787756323.196898:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787756323.197406:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787756323.197419:0:6706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787756323.197425:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756323.197427:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787756323.197433:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787756323.197451:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff98afbfcfb490) 00000020:00000080:1.0:1787756323.197472:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787756323.197478:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787756323.197573:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98afb3fb3800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787756323.197580:0:6706:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787756323.197587:0:6706:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x178386880caaaf43 00010000:00010000:1.0:1787756323.201396:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787756323.201670:0:6706:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787756323.203900:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787756323.204162:0:6706:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787756323.210139:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787756323.210593:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787756323.212237:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787756323.212249:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787756323.212256:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756323.212259:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787756323.212262:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787756323.212266:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756323.212267:0:6706:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787756323.212270:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787756323.212272:0:6706:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787756323.212312:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787756323.212315:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756323.212316:0:6706:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787756323.212319:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787756323.212672:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787756323.212693:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787756323.212710:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.212721:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756323.212728:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98afb3fb3800 from 1 10000000:01000000:1.0:1787756323.212730:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787756323.212761:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.212768:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.212788:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756323.212809:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121152:0@lo:101: 00000100:00100000:1.0:1787756323.212901:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756323.212947:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af85964240 going to sleep for 11 seconds 00000100:00100000:3.0:1787756323.222469:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287121152 00000100:00100000:3.0:1787756323.222482:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287121152 00000100:00100000:3.0:1787756323.222544:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787756323.223157:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:6688:x1874598287121152:12345-0@lo:101: 00010000:00010000:3.0:1787756323.223176:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756323.223196:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da7a00/0x178386880caaaf51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaf4a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.223224:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da7a00/0x178386880caaaf51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaf4a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.223235:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da7a00/0x178386880caaaf51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf4a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.223244:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7a00, rc 0) 00000100:00100000:3.0:1787756323.224111:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287121152:12345-0@lo:101: Request processed in 1556us (11207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756323.224119:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787756323.226160:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121152:0@lo:101: 00010000:00010000:1.0:1787756323.226187:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756323.226199:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756323.226336:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121280:0@lo:501: 00000100:00100000:1.0:1787756323.226392:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756323.226473:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af85964240 going to sleep for 11 seconds 00000100:00100000:1.0:1787756323.230022:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287121280 00000100:00100000:1.0:1787756323.230102:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287121280 00000100:00100000:1.0:1787756323.230200:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787756323.230210:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287121280:12345-0@lo:501: 00000100:00100000:1.0:1787756323.230531:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287121280:12345-0@lo:501: Request processed in 322us (4138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756323.230540:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787756323.230627:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121280:0@lo:501: 00000100:00100000:3.0:1787756323.230675:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121408:0@lo:503: 00000100:00100000:3.0:1787756323.230721:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.231038:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787756323.231183:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287121408 00000100:00100000:2.0:1787756323.231188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287121408 00000100:00100000:2.0:1787756323.231222:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787756323.231228:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287121408:12345-0@lo:503: 00000100:00100000:2.0:1787756323.231383:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287121408:12345-0@lo:503: Request processed in 154us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756323.231389:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787756323.231465:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121408:0@lo:503: 00000040:00080000:3.0:1787756323.231734:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787756323.231787:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121536:0@lo:502: 00000100:00100000:3.0:1787756323.231821:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.231875:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787756323.231986:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287121536 00000100:00100000:2.0:1787756323.231990:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287121536 00000100:00100000:2.0:1787756323.232008:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787756323.232014:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287121536:12345-0@lo:502: 00000100:00100000:2.0:1787756323.232158:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287121536:12345-0@lo:502: Request processed in 143us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756323.232165:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787756323.232284:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121536:0@lo:502: 00000040:00080000:3.0:1787756323.232496:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787756323.232539:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787756323.232572:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121664:0@lo:502: 00000100:00100000:3.0:1787756323.232606:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.232628:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787756323.232720:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287121664 00000100:00100000:2.0:1787756323.232725:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287121664 00000100:00100000:2.0:1787756323.232745:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787756323.232751:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287121664:12345-0@lo:502: 00000100:00100000:2.0:1787756323.232914:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287121664:12345-0@lo:502: Request processed in 163us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756323.232920:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787756323.232992:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121664:0@lo:502: 00000040:00080000:3.0:1787756323.233126:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787756323.233135:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787756323.233527:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787756323.233537:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756323.233539:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787756323.233546:0:6710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98afb3fb3800 00000020:00000080:3.0:1787756323.233548:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787756323.233577:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787756323.233580:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756323.233582:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787756323.233585:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787756323.233757:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787756323.233775:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787756323.233790:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.233799:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756323.233873:0:6688:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787756323.233885:0:6688:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98afb3fb3800 10000000:01000000:2.0:1787756323.233888:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98afb3fb3800 10000000:01000000:2.0:1787756323.233892:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787756323.233898:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98afb3fb3800 from 1 10000000:01000000:2.0:1787756323.233901:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787756323.233928:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.233936:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.233944:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756323.233959:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121792:0@lo:101: 00000100:00100000:2.0:1787756323.233995:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756323.234017:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787756323.234128:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287121792 00000100:00100000:3.0:1787756323.234133:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287121792 00000100:00100000:3.0:1787756323.234155:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787756323.234161:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287121792:12345-0@lo:101: 00010000:00010000:3.0:1787756323.234170:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756323.234182:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da7400/0x178386880caaaf5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaf58 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.234208:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da7400/0x178386880caaaf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaf58 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.234217:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da7400/0x178386880caaaf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf58 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.234225:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7400, rc 0) 00000100:00100000:3.0:1787756323.234261:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:6688:x1874598287121792:12345-0@lo:101: Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756323.234267:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787756323.234326:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121792:0@lo:101: 00010000:00010000:2.0:1787756323.234337:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.234345:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756323.234407:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121920:0@lo:501: 00000100:00100000:2.0:1787756323.234428:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756323.234446:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787756323.234497:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287121920 00000100:00100000:1.0:1787756323.234501:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287121920 00000100:00100000:1.0:1787756323.234522:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787756323.234527:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:6688:x1874598287121920:12345-0@lo:501: 00000100:00100000:1.0:1787756323.234786:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:6688:x1874598287121920:12345-0@lo:501: Request processed in 258us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756323.234792:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787756323.234910:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287121920:0@lo:501: 00000100:00100000:2.0:1787756323.234935:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287122048:0@lo:503: 00000100:00100000:2.0:1787756323.234975:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756323.235000:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787756323.235136:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287122048 00000100:00100000:3.0:1787756323.235140:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287122048 00000100:00100000:3.0:1787756323.235157:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787756323.235162:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:6688:x1874598287122048:12345-0@lo:503: 00000100:00100000:3.0:1787756323.235298:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:6688:x1874598287122048:12345-0@lo:503: Request processed in 135us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756323.235305:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787756323.235367:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287122048:0@lo:503: 00000040:00080000:2.0:1787756323.235586:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787756323.235635:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287122176:0@lo:502: 00000100:00100000:2.0:1787756323.235665:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756323.235685:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787756323.235783:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287122176 00000100:00100000:3.0:1787756323.235788:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287122176 00000100:00100000:3.0:1787756323.235806:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787756323.235812:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:6688:x1874598287122176:12345-0@lo:502: 00000100:00100000:3.0:1787756323.235994:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:6688:x1874598287122176:12345-0@lo:502: Request processed in 181us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756323.236001:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787756323.236398:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287122176:0@lo:502: 00000040:00080000:2.0:1787756323.236724:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787756323.236774:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787756323.236800:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787756323.236991:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787756323.237101:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787756323.237166:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787756323.237208:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787756323.237245:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787756323.237292:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787756323.237323:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787756323.237348:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787756323.237385:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787756323.237411:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787756323.237450:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787756323.237497:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787756323.237528:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787756323.237737:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787756323.237787:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787756323.237816:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787756323.238011:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787756323.238125:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787756323.238157:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787756323.238201:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787756323.238242:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787756323.238270:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787756323.238297:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787756323.238335:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787756323.238363:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787756323.238399:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287122304:0@lo:502: 00000100:00100000:2.0:1787756323.238462:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756323.238530:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787756323.238621:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287122304 00000100:00100000:3.0:1787756323.238628:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287122304 00000100:00100000:3.0:1787756323.238708:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787756323.238723:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:6688:x1874598287122304:12345-0@lo:502: 00000100:00100000:3.0:1787756323.238954:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:6688:x1874598287122304:12345-0@lo:502: Request processed in 231us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756323.238961:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787756323.239051:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287122304:0@lo:502: 00000040:00080000:2.0:1787756323.239120:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787756323.239130:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787756323.239654:0:6711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787756323.239670:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff98af87e74ed8) 00000020:00000080:2.0:1787756323.239687:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787756323.239746:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98afb3fb3800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787756323.239749:0:6711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98afb3fb3800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787756323.239752:0:6711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98afb3fb3800 3 00010000:00080000:2.0:1787756323.239776:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98af85d5f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.121@tcp at head 00010000:00010000:2.0:1787756323.242717:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787756323.242979:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787756323.243013:0:6711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787756323.243089:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x178386880caaaf6d 00000100:00080000:2.0:1787756323.243099:0:6711:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787756323.243105:0:6711:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff98af85d5f000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:2.0:1787756323.243137:0:6711:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98af99aa8780 x1874598287122432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787756323.243159:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787756323.243418:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287122560:0@lo:400: 00000100:00100000:0.0:1787756323.243489:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.243601:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874598287122432:0@lo:38: 00000100:00100000:3.0:1787756323.243633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756323.243718:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287122560 00000100:00100000:0.0:1787756323.243724:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287122560 00000100:00100000:0.0:1787756323.243767:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287122432 00000100:00100000:0.0:1787756323.243770:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287122432 00000100:00100000:0.0:1787756323.243785:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787756323.243793:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89912d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287122560:12345-0@lo:400: 00000100:00100000:0.0:1787756323.243874:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89912d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287122560:12345-0@lo:400: Request processed in 80us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756323.243888:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787756323.243904:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787756323.243908:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bf4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1874598287122432:12345-0@lo:38: 00010000:00080000:0.0:1787756323.243928:0:5843:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:0.0:1787756323.243954:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x178386880caaaf74 00000004:00100000:0.0:1787756323.243966:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787756323.243993:0:5843:0:(import.c:65:import_set_state_nolock()) ffff98afbb54d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787756323.244040:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bf4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874598287122432:12345-0@lo:38: Request processed in 130us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756323.244047:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787756323.244082:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98af89911e00 x1874598287122560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756323.244094:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89911e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287122560:0@lo:400: 00010000:00080000:3.0:1787756323.244286:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff98af99aa8780 x1874598287122432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787756333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756323.244294:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787756323.244299:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787756323.244305:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787756323.244309:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787756323.244311:0:3308:0:(import.c:65:import_set_state_nolock()) ffff98af85d5f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787756323.244316:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1874598287122432:0@lo:38: 00000040:00080000:2.0:1787756323.244504:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787756323.244774:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787756323.244796:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787756323.244818:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756323.244829:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787756323.244908:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787756323.244910:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787756323.244912:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787756323.244913:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787756323.244914:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787756323.244916:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787756323.244918:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787756323.244924:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787756323.244925:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787756323.244927:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787756323.244928:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787756323.244932:0:6688:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787756323.244934:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787756323.244935:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787756323.244936:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787756323.244937:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787756323.244938:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787756323.244939:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787756323.244940:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787756323.244941:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787756323.244942:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787756323.244942:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787756323.244943:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787756323.244963:0:6688:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787756323.244976:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89911e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287122688:0@lo:253: 00000100:00100000:0.0:1787756323.245018:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756323.245167:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9029d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787756323.245203:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287122688 00000100:00100000:3.0:1787756323.245208:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287122688 00000100:00100000:3.0:1787756323.245241:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787756323.245249:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:6688:x1874598287122688:12345-0@lo:253: 20000000:01000000:3.0:1787756323.245266:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787756323.245279:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787756323.268982:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787756323.268996:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787756323.269028:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787756323.269033:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787756323.269056:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.269075:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98afc2045000/0x178386880caaaeda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaed3 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.269097:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.269134:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98afc2045000/0x178386880caaaeda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaaed3 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.269148:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98afc2045000/0x178386880caaaeda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaaed3 expref: 13 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756323.269164:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf52c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874598287122816:0@lo:104: 00000100:00100000:3.0:1787756323.269228:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.269273:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787756323.269295:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287122816 00000100:00100000:3.0:1787756323.269301:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287122816 00000100:00100000:3.0:1787756323.269341:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787756323.269349:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5858:x1874598287122816:12345-0@lo:104: 00010000:00010000:3.0:1787756323.269359:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caaaed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.269404:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787756323.269410:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5858:x1874598287122816:12345-0@lo:104: Request processed in 63us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756323.269418:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787756323.269439:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787756323.269445:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caaaed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.269452:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af84da6800 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:3.0:1787756323.269463:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caaaed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.269471:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caaaed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787756323.269477:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caaaed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787756323.269483:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787756323.269509:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caaaed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.269515:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787756323.269534:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caaaed3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.269541:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caaaed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaeda expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756323.270371:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287122944:0@lo:103: 00000100:00100000:3.0:1787756323.270413:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756323.270804:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf52c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874598287122816:0@lo:104: 00010000:00010000:3.0:1787756323.270826:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.270876:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756323.270878:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756323.270880:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756323.271436:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287122944 00000100:00100000:2.0:1787756323.271443:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287122944 00010000:00010000:2.0:1787756323.271472:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98afc2045000/0x178386880caaaeda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaed3 expref: 14 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756323.271533:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787756323.271542:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:3312:x1874598287122944:12345-0@lo:103: 00010000:00010000:2.0:1787756323.271565:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787756323.271570:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98afc2045000/0x178386880caaaeda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaed3 expref: 14 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.271581:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98afc2045000/0x178386880caaaeda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaaed3 expref: 14 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.271596:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afc2045000/0x178386880caaaeda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaaed3 expref: 14 pid: 5836 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.271611:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.271618:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787756323.271631:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005489842s 00010000:00010000:2.0:1787756323.271635:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.271641:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.271647:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.271665:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.271670:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af84da7600 already unused, calling callback (ffffffffc162d530) 00010000:00010000:2.0:1787756323.271675:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.271682:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.271699:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756323.271708:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787756323.271765:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:3312:x1874598287122944:12345-0@lo:103: Request processed in 224us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756323.271772:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787756323.271870:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.271883:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756323.271888:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da7600/0x178386880caaaf7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756323.272046:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287122944:0@lo:103: 00000100:00100000:0.0:1787756323.278885:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:6688:x1874598287122688:12345-0@lo:253: Request processed in 33627us (33856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756323.278900:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787756323.279106:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89911e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:6688:1874598287122688:0@lo:253: 10000000:01000000:2.0:1787756323.279122:0:6688:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787756323.279126:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787756323.279127:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787756323.279129:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787756323.279130:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787756323.279131:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787756323.279132:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787756323.279133:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787756323.279135:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787756323.279137:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787756323.279138:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787756323.279140:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787756323.279155:0:6688:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787756323.283409:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787756323.283636:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787756323.283825:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787756323.284054:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787756323.284310:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787756323.284473:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787756323.286266:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787756323.527544:0:6688:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787756323.527551:0:6688:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787756323.527580:0:6688:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787756323.527635:0:6688:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787756323.527651:0:6688:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787756323.527689:0:6688:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787756323.994140:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756325.018315:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756326.041997:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756327.064485:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756328.089184:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756328.472118:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787756328.472145:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874598287123328:0@lo:400: 00000100:00100000:3.0:1787756328.472213:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287123200:0@lo:400: 00000100:00100000:2.0:1787756328.472214:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756328.472242:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756328.472291:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287123328 00000100:00100000:2.0:1787756328.472298:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287123328 00000100:00080000:0.0:1787756328.472331:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787756328.472350:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287123200 00000100:00100000:2.0:1787756328.472354:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287123200 00000100:00100000:2.0:1787756328.472371:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787756328.472379:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874598287123328:12345-0@lo:400: 00000100:00100000:2.0:1787756328.472429:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aa9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874598287123328:12345-0@lo:400: Request processed in 50us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756328.472436:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287123072:0@lo:400: 00000100:00100000:2.0:1787756328.472440:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787756328.472461:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787756328.472468:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bf7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287123200:12345-0@lo:400: 00000100:00100000:1.0:1787756328.472482:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756328.472530:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bf7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287123200:12345-0@lo:400: Request processed in 62us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756328.472537:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787756328.472569:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99aab840 x1874598287123328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756328.472583:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874598287123328:0@lo:400: 00010000:00080000:3.0:1787756328.474883:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99aab0c0 x1874598287123200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756328.474901:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287123200:0@lo:400: 00000100:00100000:3.0:1787756328.474933:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287123072 00000100:00100000:3.0:1787756328.474938:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287123072 00000100:00100000:3.0:1787756328.474977:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787756328.474985:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:3309:x1874598287123072:12345-0@lo:400: 00000100:00100000:3.0:1787756328.475057:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:3309:x1874598287123072:12345-0@lo:400: Request processed in 72us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756328.475065:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787756328.477186:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287123072:0@lo:400: 00000001:02000400:1.0:1787756328.914250:0:7056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1787756328.984204:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787756328.984227:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98af903a6800 from 21 10000000:01000000:2.0:1787756328.984233:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787756328.984275:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756328.984287:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756328.984298:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756328.984322:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287123456:0@lo:101: 00000100:00100000:2.0:1787756328.984385:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756328.984428:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787756328.988936:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287123456 00000100:00100000:2.0:1787756328.988950:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287123456 00000100:00100000:2.0:1787756328.989010:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787756328.989020:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5839:x1874598287123456:12345-0@lo:101: 00010000:00010000:2.0:1787756328.989035:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756328.989051:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98afc2045000/0x178386880caaaf89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaf82 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756328.989078:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afc2045000/0x178386880caaaf89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaf82 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756328.989090:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98afc2045000/0x178386880caaaf89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf82 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756328.989099:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2045000, rc 0) 00000100:00100000:2.0:1787756328.989171:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287123456:12345-0@lo:101: Request processed in 154us (4786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756328.989185:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787756328.989237:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287123456:0@lo:101: 00010000:00010000:2.0:1787756328.989254:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756328.989263:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756328.989321:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287123584:0@lo:501: 00000100:00100000:2.0:1787756328.989351:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756328.989377:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787756328.990359:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287123584 00000100:00100000:2.0:1787756328.990365:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287123584 00000100:00100000:2.0:1787756328.990397:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787756328.990405:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287123584:12345-0@lo:501: 00000100:00100000:2.0:1787756328.990625:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287123584:12345-0@lo:501: Request processed in 220us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756328.990634:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787756328.990675:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287123584:0@lo:501: 00000100:00100000:2.0:1787756328.990710:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287123712:0@lo:503: 00000100:00100000:2.0:1787756328.990751:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756328.990776:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130a840 going to sleep for 11 seconds 00000100:00100000:2.0:1787756328.990789:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287123712 00000100:00100000:2.0:1787756328.990792:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287123712 00000100:00100000:2.0:1787756328.990828:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787756328.990855:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287123712:12345-0@lo:503: 00000100:00100000:2.0:1787756328.991094:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287123712:12345-0@lo:503: Request processed in 259us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756328.991100:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787756328.991141:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287123712:0@lo:503: 00000100:00100000:2.0:1787756328.991287:0:7061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7061:1874598287123840:0@lo:502: 00000100:00100000:2.0:1787756328.991324:0:7061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756328.991347:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287123840 00000100:00100000:2.0:1787756328.991350:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287123840 00000100:00100000:2.0:1787756328.991373:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787756328.991379:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7061:x1874598287123840:12345-0@lo:502: 00000100:00100000:2.0:1787756328.991515:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7061:x1874598287123840:12345-0@lo:502: Request processed in 136us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756328.991522:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787756328.991551:0:7061:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787756328.991562:0:7061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7061:1874598287123840:0@lo:502: 00000100:00100000:2.0:1787756328.991601:0:7061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7061:1874598287123968:0@lo:502: 00000100:00100000:2.0:1787756328.991633:0:7061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756328.991653:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287123968 00000100:00100000:2.0:1787756328.991656:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287123968 00000100:00100000:2.0:1787756328.991676:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787756328.991682:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7061:x1874598287123968:12345-0@lo:502: 00000100:00100000:2.0:1787756328.991804:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7061:x1874598287123968:12345-0@lo:502: Request processed in 122us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756328.991812:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787756328.991871:0:7061:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787756328.994371:0:7061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7061:1874598287123968:0@lo:502: 00000040:00080000:2.0:1787756328.994420:0:7061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787756329.001217:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787756329.001249:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787756329.001260:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756329.001273:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756329.001345:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787756329.001349:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98af903a6800 from 4 10000000:01000000:2.0:1787756329.001352:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787756329.001390:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756329.001399:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756329.001410:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756329.001433:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287124096:0@lo:101: 00000100:00100000:2.0:1787756329.001501:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756329.001550:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787756329.002110:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287124096 00000100:00100000:3.0:1787756329.002125:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287124096 00000100:00100000:3.0:1787756329.002173:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787756329.002183:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287124096:12345-0@lo:101: 00010000:00010000:3.0:1787756329.002195:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756329.002208:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da7600/0x178386880caaaf97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaf90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756329.002231:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da7600/0x178386880caaaf97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaf90 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756329.002242:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da7600/0x178386880caaaf97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf90 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756329.002250:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7600, rc 0) 00000100:00100000:3.0:1787756329.002293:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287124096:12345-0@lo:101: Request processed in 112us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756329.002300:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787756329.002375:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287124096:0@lo:101: 00010000:00010000:0.0:1787756329.002389:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756329.002398:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756329.002447:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89912940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287124224:0@lo:256: 00000100:00100000:0.0:1787756329.002479:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756329.002512:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfd5b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787756329.002556:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287124224 00000100:00100000:2.0:1787756329.002561:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287124224 00000100:00100000:2.0:1787756329.002593:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787756329.002601:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287124224:12345-0@lo:256: 20000000:01000000:2.0:1787756329.002613:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787756329.002629:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787756329.002632:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787756329.002706:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287124224:12345-0@lo:256: Request processed in 106us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756329.002713:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787756329.002742:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89912940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287124224:0@lo:256: 10000000:01000000:2.0:1787756329.002782:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787756329.002792:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756329.002799:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756329.002807:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787756329.002810:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787756329.002813:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787756329.002866:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756329.002874:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756329.002892:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756329.002906:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287124352:0@lo:101: 00000100:00100000:2.0:1787756329.002933:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756329.002947:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756329.002958:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287124352 00000100:00100000:2.0:1787756329.002961:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287124352 00000100:00100000:2.0:1787756329.002982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787756329.002990:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287124352:12345-0@lo:101: 00010000:00010000:2.0:1787756329.002997:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756329.003006:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98afc2045200/0x178386880caaafa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaf9e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756329.003022:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afc2045200/0x178386880caaafa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaf9e expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756329.003039:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98afc2045200/0x178386880caaafa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf9e expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756329.003046:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2045200, rc 0) 00000100:00100000:2.0:1787756329.003077:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287124352:12345-0@lo:101: Request processed in 88us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756329.003083:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787756329.003111:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287124352:0@lo:101: 00010000:00010000:2.0:1787756329.003121:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756329.003128:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756329.003171:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287124480:0@lo:501: 00000100:00100000:2.0:1787756329.003192:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756329.003205:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756329.003218:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287124480 00000100:00100000:2.0:1787756329.003222:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287124480 00000100:00100000:2.0:1787756329.003237:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787756329.003243:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287124480:12345-0@lo:501: 00000100:00100000:2.0:1787756329.003479:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287124480:12345-0@lo:501: Request processed in 235us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756329.003485:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787756329.003514:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287124480:0@lo:501: 00000100:00100000:2.0:1787756329.003540:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287124608:0@lo:503: 00000100:00100000:2.0:1787756329.003583:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756329.003600:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756329.003612:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287124608 00000100:00100000:2.0:1787756329.003615:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287124608 00000100:00100000:2.0:1787756329.003634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787756329.003641:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287124608:12345-0@lo:503: 00000100:00100000:2.0:1787756329.003893:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287124608:12345-0@lo:503: Request processed in 250us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756329.003900:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787756329.003944:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287124608:0@lo:503: 00000100:00100000:2.0:1787756329.004118:0:7062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7062:1874598287124736:0@lo:502: 00000100:00100000:2.0:1787756329.004157:0:7062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756329.004176:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287124736 00000100:00100000:2.0:1787756329.004180:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287124736 00000100:00100000:2.0:1787756329.004201:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787756329.004208:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:7062:x1874598287124736:12345-0@lo:502: 00000100:00100000:2.0:1787756329.004374:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:7062:x1874598287124736:12345-0@lo:502: Request processed in 166us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756329.004381:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787756329.004408:0:7062:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787756329.004419:0:7062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa9680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7062:1874598287124736:0@lo:502: 00000020:01000000:2.0:1787756329.004439:0:7062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787756329.004446:0:7062:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787756329.004452:0:7062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787756329.004454:0:7062:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787756329.004459:0:7062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787756329.004467:0:7062:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.121@tcp to nid 0x20000c0a8cb79 (192.168.203.121@tcp) 00000020:01000000:2.0:1787756329.004488:0:7062:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787756329.004491:0:7062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787756329.004504:0:7062:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff98af87e73490) 00000020:00000080:2.0:1787756329.004521:0:7062:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787756329.004526:0:7062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787756329.004589:0:7062:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787756329.004595:0:7062:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787756329.004602:0:7062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x178386880caaafb3 00010000:00080000:2.0:1787756329.004641:0:7062:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98afbccdd800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:2.0:1787756329.004885:0:7062:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787756329.107546:0:7062:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787756329.107564:0:7062:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787756329.108336:0:7062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787756329.108514:0:7062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787756329.108565:0:7062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787756329.108625:0:7062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787756329.109239:0:7073:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787756329.109254:0:7073:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787756329.110196:0:7062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787756329.110208:0:7062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787756329.110416:0:7062:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787756329.110439:0:7062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x178386880caaafba 00000100:00080000:0.0:1787756329.110460:0:7062:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787756329.110467:0:7062:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff98afbccdd800 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:0.0:1787756329.110611:0:7062:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98af899121c0 x1874598287124864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787756329.110685:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874598287124864:0@lo:8: 00000100:00100000:2.0:1787756329.110755:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787756329.110856:0:7062:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787756329.110877:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287124864 00000100:00100000:1.0:1787756329.110885:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287124864 00000100:00100000:1.0:1787756329.110918:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787756329.110926:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aa9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1874598287124864:12345-0@lo:8: 00010000:00080000:1.0:1787756329.110948:0:6690:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:01000000:0.0:1787756329.110950:0:7062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787756329.110957:0:7062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756329.110960:0:7062:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787756329.110963:0:7062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787756329.110969:0:7062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756329.110971:0:7062:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787756329.110975:0:7062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787756329.110976:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x178386880caaafc1 00000020:00000080:0.0:1787756329.110977:0:7062:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787756329.111013:0:7062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89913c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7062:1874598287124992:0@lo:502: 00000100:00100000:0.0:1787756329.111056:0:7062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756329.111087:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287124992 00000100:00100000:0.0:1787756329.111091:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287124992 00002000:00100000:1.0:1787756329.111091:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff98af85ba3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787756329.111098:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787756329.111102:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787756329.111123:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787756329.111132:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:7062:x1874598287124992:12345-0@lo:502: 00002000:00100000:1.0:1787756329.111233:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787756329.111382:0:6690:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787756329.111406:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98af85ba4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787756329.113650:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aa9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874598287124864:12345-0@lo:8: Request processed in 2714us (2885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756329.113663:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787756329.113678:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af899121c0 x1874598287124864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787756339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756329.113691:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787756329.113699:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787756329.113708:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787756329.113713:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787756329.113716:0:3308:0:(import.c:65:import_set_state_nolock()) ffff98afbccdd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787756329.113729:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787756329.113736:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874598287124864:0@lo:8: 00000100:00100000:0.0:1787756329.115956:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:7062:x1874598287124992:12345-0@lo:502: Request processed in 4817us (4892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756329.115971:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:0.0:1787756329.116032:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787756329.116057:0:7073:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787756329.116187:0:7073:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 188004353430ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787756329.116275:0:7062:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfd5b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787756329.116301:0:7062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89913c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7062:1874598287124992:0@lo:502: 00000020:01000000:0.0:1787756329.116335:0:7062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787756329.116342:0:7062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756329.116345:0:7062:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787756329.116349:0:7062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787756329.116407:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787756329.116423:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787756329.116431:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756329.116452:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787756329.116462:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787756329.116465:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98af87ff1a48 from 1 10000000:01000000:0.0:1787756329.116467:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787756329.116812:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756329.116830:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756329.116867:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756329.116887:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89913c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287125120:0@lo:101: 00000100:00100000:0.0:1787756329.116951:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756329.116977:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9e0eb900 going to sleep for 11 seconds 00000100:00100000:0.0:1787756329.116994:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287125120 00000100:00100000:0.0:1787756329.116998:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287125120 00000100:00100000:0.0:1787756329.117032:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787756329.117039:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287125120:12345-0@lo:101: 00010000:00010000:0.0:1787756329.117050:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756329.117061:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af80030400/0x178386880caaafcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaafc8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756329.117083:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af80030400/0x178386880caaafcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaafc8 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756329.117092:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af80030400/0x178386880caaafcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaafc8 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756329.117100:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af80030400, rc 0) 00000100:00100000:0.0:1787756329.117132:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287125120:12345-0@lo:101: Request processed in 94us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756329.117139:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787756329.117179:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89913c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287125120:0@lo:101: 00010000:00010000:0.0:1787756329.117192:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756329.117200:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756329.118596:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89913c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287125248:0@lo:501: 00000100:00100000:0.0:1787756329.118755:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756329.118793:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfd5bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787756329.118847:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287125248 00000100:00100000:0.0:1787756329.118853:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287125248 00000100:00100000:0.0:1787756329.118888:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787756329.119324:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287125248:12345-0@lo:501: 00000100:00100000:0.0:1787756329.120766:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287125248:12345-0@lo:501: Request processed in 1442us (2006us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787756329.120779:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787756329.120868:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89913c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287125248:0@lo:501: 10000000:01000000:0.0:1787756329.121589:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787756329.121600:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756329.121611:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787756329.209343:0:7074:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787756329.209374:0:7074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1874598287125504:0@lo:7: 00000100:00100000:2.0:1787756329.209435:0:7074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756329.211915:0:7074:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7ae40 going to sleep for 11 seconds 00000004:00080000:2.0:1787756329.211944:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787756329.211995:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287125376:0@lo:13: 00000100:00100000:2.0:1787756329.212044:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756329.212091:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287125504 00000100:00100000:2.0:1787756329.212098:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287125504 00000100:00100000:2.0:1787756329.212146:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787756329.212154:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7074:x1874598287125504:12345-0@lo:7: 00000100:00100000:2.0:1787756329.221958:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287125376 00000100:00100000:2.0:1787756329.221970:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287125376 00000100:00100000:2.0:1787756329.222026:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787756329.222037:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874598287125376:12345-0@lo:13: 00002000:00000024:2.0:1787756329.222069:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787756329.222147:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874598287125376:12345-0@lo:13: Request processed in 112us (10101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756329.222154:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787756329.222176:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787756329.222243:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99aab840 x1874598287125376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756329.222263:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287125376:0@lo:13: 00002000:00080000:3.0:1787756329.228255:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787756329.228263:0:6693:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787756329.228359:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7074:x1874598287125504:12345-0@lo:7: Request processed in 16201us (18919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756329.228371:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787756329.228464:0:7074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99aa8b40 x1874598287125504/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787756345 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756329.228490:0:7074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1874598287125504:0@lo:7: 00000004:00080000:0.0:1787756329.228504:0:7074:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787756329.228543:0:7074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89913c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1874598287125632:0@lo:5: 00000100:00100000:0.0:1787756329.228579:0:7074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756329.228631:0:7074:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af85f18840 going to sleep for 11 seconds 00000100:00100000:3.0:1787756329.228824:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287125632 00000100:00100000:3.0:1787756329.228831:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287125632 00000100:00100000:3.0:1787756329.229583:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787756329.229594:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7074:x1874598287125632:12345-0@lo:5: 00002000:00080000:3.0:1787756329.229621:0:6692:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787756329.229625:0:6692:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787756329.230166:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7074:x1874598287125632:12345-0@lo:5: Request processed in 573us (1584us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787756329.230188:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787756329.230438:0:7074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af89913c00 x1874598287125632/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787756345 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756329.230525:0:7074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89913c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1874598287125632:0@lo:5: 00000004:00080000:1.0:1787756329.230537:0:7074:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787756329.230569:0:7074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1874598287125760:0@lo:700: 00000100:00100000:1.0:1787756329.230600:0:7074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756329.230626:0:7074:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af85bf2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787756329.230916:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287125760 00000100:00100000:0.0:1787756329.230922:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287125760 00000100:00100000:0.0:1787756329.230958:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787756329.230971:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7074:x1874598287125760:12345-0@lo:700: 00000100:00100000:0.0:1787756329.231058:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89912580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1874598287125888:0@lo:700: 00000100:00100000:0.0:1787756329.231091:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756329.231118:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af85f18e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787756329.231244:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287125888 00000100:00100000:3.0:1787756329.231249:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287125888 00000100:00100000:3.0:1787756329.231283:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787756329.231290:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89911680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1874598287125888:12345-0@lo:700: 40000000:02000000:3.0:1787756329.283393:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1787756329.294045:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89911680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1874598287125888:12345-0@lo:700: Request processed in 62746us (62944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756329.294058:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787756329.294636:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af89912580 x1874598287125888/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787756345 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756329.294653:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89912580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1874598287125888:0@lo:700: 40000000:02000000:0.0:1787756329.294665:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1787756329.357907:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7074:x1874598287125760:12345-0@lo:700: Request processed in 126933us (127297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756329.357925:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787756329.357990:0:7074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99bef480 x1874598287125760/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787756345 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756329.358007:0:7074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1874598287125760:0@lo:700: 00000001:00100000:0.0:1787756329.358438:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787756329.358456:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:1.0:1787756329.390969:0:7074:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787756329.395168:0:7074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1874598287126016:0@lo:5: 00000100:00100000:1.0:1787756329.395230:0:7074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756329.395308:0:7074:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af85bf2780 going to sleep for 11 seconds 00000100:00100000:3.0:1787756329.395370:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287126016 00000100:00100000:3.0:1787756329.395376:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287126016 00000100:00100000:3.0:1787756329.395453:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787756329.395462:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7074:x1874598287126016:12345-0@lo:5: 00002000:00080000:3.0:1787756329.404566:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787756329.404587:0:6693:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787756329.409648:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7074:x1874598287126016:12345-0@lo:5: Request processed in 14179us (14410us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787756329.409662:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787756329.409803:0:7074:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99bef480 x1874598287126016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787756345 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756329.409824:0:7074:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787756329.409873:0:7074:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98af99bef480 x1874598287126016/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787756345 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756329.409897:0:7074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bef480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7074:1874598287126016:0@lo:5: 00000004:00080000:1.0:1787756329.409912:0:7074:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787756330.136137:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756331.160152:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756332.189164:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756333.208004:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787756333.220624:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1787756334.232007:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756334.617738:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287126400:0@lo:400: 00000100:00100000:2.0:1787756334.617813:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756334.617887:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787756334.617894:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287126528:0@lo:400: 00000100:00100000:2.0:1787756334.617939:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756334.618044:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287126400 00000100:00100000:2.0:1787756334.618051:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287126400 00000100:00100000:2.0:1787756334.618098:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787756334.618112:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287126400:12345-0@lo:400: 00000100:00100000:2.0:1787756334.618160:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287126400:12345-0@lo:400: Request processed in 50us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756334.618168:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787756334.618188:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787756334.618212:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99aa8780 x1874598287126400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756334.618225:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287126400:0@lo:400: 00000100:00100000:3.0:1787756334.618363:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287126272:0@lo:400: 00000100:00100000:3.0:1787756334.618391:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756334.618418:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787756334.618424:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287126144:0@lo:400: 00000100:00100000:3.0:1787756334.618450:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756334.618531:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287126656:0@lo:13: 00000100:00100000:3.0:1787756334.618567:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756334.618594:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287126528 00000100:00100000:3.0:1787756334.618598:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287126528 00000100:00100000:3.0:1787756334.618637:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787756334.618645:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287126528:12345-0@lo:400: 00000100:00100000:3.0:1787756334.618679:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287126528:12345-0@lo:400: Request processed in 35us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756334.618685:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787756334.618706:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287126656 00000100:00100000:3.0:1787756334.618709:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287126656 00000100:00100000:3.0:1787756334.618729:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787756334.618734:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bf5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287126656:12345-0@lo:13: 00002000:00000024:3.0:1787756334.618759:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787756334.618802:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bf5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287126656:12345-0@lo:13: Request processed in 67us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756334.618809:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787756334.618854:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99bf52c0 x1874598287126656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756334.618864:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787756334.618878:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287126656:0@lo:13: 00000100:00080000:3.0:1787756334.618892:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787756334.618909:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99aab840 x1874598287126528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756334.618918:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287126528:0@lo:400: 00000100:00100000:0.0:1787756334.619072:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287126272 00000100:00100000:0.0:1787756334.619076:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287126272 00000100:00100000:0.0:1787756334.619102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787756334.619109:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bf70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287126272:12345-0@lo:400: 00000100:00100000:0.0:1787756334.619157:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bf70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287126272:12345-0@lo:400: Request processed in 48us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756334.619164:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787756334.619182:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287126144 00000100:00100000:0.0:1787756334.619185:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287126144 00000100:00100000:0.0:1787756334.619205:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787756334.619211:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:3310:x1874598287126144:12345-0@lo:400: 00000100:00100000:0.0:1787756334.619239:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:3310:x1874598287126144:12345-0@lo:400: Request processed in 28us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756334.619245:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787756334.619298:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287126144:0@lo:400: 00010000:00080000:0.0:1787756334.619308:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99aab480 x1874598287126272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756334.619317:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287126272:0@lo:400: 00010000:00010000:0.0:1787756335.257019:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756336.287211:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756337.304168:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756338.328374:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787756338.997310:0:7636:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787756338.997314:0:7636:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787756338.997444:0:7636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff98af85ba0800 00000020:01000004:1.0:1787756338.997459:0:7636:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787756338.997472:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787756338.997484:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff98afbfcf9a48) 00000020:00000080:1.0:1787756338.997498:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787756339.012505:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787756339.013199:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787756339.037636:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787756339.050492:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787756339.050530:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787756339.050586:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787756339.051511:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787756339.052462:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787756339.052474:0:7636:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787756339.052484:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x178386880caaafdd 00000020:01000004:2.0:1787756339.052491:0:7636:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787756339.052511:0:7636:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787756339.052514:0:7636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787756339.052520:0:7636:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787756339.052539:0:7636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787756339.052542:0:7636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787756339.075217:0:7636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787756339.075275:0:7636:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.121@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787756339.075280:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787756339.075282:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787756339.075283:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787756339.075284:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787756339.075285:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787756339.075287:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787756339.075288:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787756339.075290:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787756339.075291:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787756339.075298:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787756339.075299:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787756339.075302:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787756339.075304:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787756339.075306:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787756339.075307:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787756339.075308:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787756339.075308:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787756339.075309:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787756339.075310:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787756339.075311:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787756339.075312:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787756339.075313:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787756339.075314:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787756339.075337:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787756339.075354:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287126784:0@lo:253: 00000100:00100000:2.0:1787756339.075420:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756339.075523:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa011c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787756339.075600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287126784 00000100:00100000:0.0:1787756339.075665:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287126784 00000100:00100000:0.0:1787756339.075819:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787756339.075829:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:7636:x1874598287126784:12345-0@lo:253: 20000000:01000000:0.0:1787756339.075875:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787756339.075879:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787756339.075884:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787756339.075887:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787756339.077458:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787756339.078316:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787756339.078334:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787756339.078390:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787756339.078399:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787756339.078429:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787756339.078490:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787756339.079486:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787756339.079511:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:1.0:1787756339.079513:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:1.0:1787756339.080068:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787756339.080209:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787756339.080273:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787756339.080282:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:1.0:1787756339.080427:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787756339.080440:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787756339.080476:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787756339.080552:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787756339.082227:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787756339.082254:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.121@tcp 20000000:01000000:1.0:1787756339.082256:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.121@tcp (null) (null) (null) 00000040:00080000:1.0:1787756339.082295:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787756339.082303:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787756339.082355:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787756339.082363:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.121@tcp (null) (null) 00000040:00080000:1.0:1787756339.082392:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787756339.082409:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787756339.082459:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787756339.082494:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787756339.082510:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787756339.082513:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787756339.082517:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787756339.082528:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787756339.082530:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787756339.082563:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787756339.082566:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787756339.083409:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787756339.083736:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787756339.084067:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787756339.084249:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787756339.084262:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787756339.084264:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787756339.087484:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787756339.087573:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787756339.087701:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787756339.088389:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787756339.088429:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787756339.088486:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787756339.088498:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787756339.088500:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787756339.089670:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787756339.089823:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787756339.090227:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787756339.090519:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787756339.090564:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787756339.090684:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787756339.090698:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787756339.090701:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787756339.091720:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787756339.092054:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787756339.092233:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787756339.092534:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787756339.092578:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787756339.092684:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787756339.092701:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787756339.092703:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787756339.092712:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787756339.092729:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093066:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af80030c00/0x178386880caaaf35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf2e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093190:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af84da7400/0x178386880caaaf5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf58 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093198:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98afc2045000/0x178386880caaaf89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf82 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093205:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98afc2045200/0x178386880caaafa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf9e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093212:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af80030400/0x178386880caaafcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaafc8 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093220:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093256:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af80030400/0x178386880caaafcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaafc8 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093272:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af80030400/0x178386880caaafcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaafc8 expref: 16 pid: 5836 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.093286:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bed2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874598287126912:0@lo:104: 00000100:00100000:1.0:1787756339.093347:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787756339.093435:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98afc2045200/0x178386880caaafa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaaf9e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093444:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98afc2045200/0x178386880caaafa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaaf9e expref: 16 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.093460:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99becf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874598287127040:0@lo:104: 00010000:00010000:1.0:1787756339.093485:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98afc2045000/0x178386880caaaf89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaaf82 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093493:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98afc2045000/0x178386880caaaf89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaaf82 expref: 16 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.093500:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99beed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874598287127168:0@lo:104: 00010000:00010000:1.0:1787756339.093538:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af84da7400/0x178386880caaaf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaaf58 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093546:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af84da7400/0x178386880caaaf5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaaf58 expref: 16 pid: 5837 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.093554:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bef480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874598287127296:0@lo:104: 00010000:00010000:1.0:1787756339.093577:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af80030c00/0x178386880caaaf35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaaf2e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.093585:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af80030c00/0x178386880caaaf35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaaf2e expref: 16 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.093592:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874598287127424:0@lo:104: 00000100:00100000:1.0:1787756339.093619:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c69a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787756339.093725:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787756339.093820:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756339.095716:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.096016:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287126912 00000100:00100000:0.0:1787756339.096024:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287126912 00000100:00100000:0.0:1787756339.096065:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287127040 00000100:00100000:0.0:1787756339.096069:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287127040 00000100:00100000:0.0:1787756339.096091:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787756339.096100:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8688b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:5835:x1874598287126912:12345-0@lo:104: 00010000:00010000:0.0:1787756339.096115:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096191:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787756339.096197:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8688b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:5835:x1874598287126912:12345-0@lo:104: Request processed in 98us (2850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.096204:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787756339.096245:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787756339.096252:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bf4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5835:x1874598287127040:12345-0@lo:104: 00010000:00010000:0.0:1787756339.096259:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096295:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787756339.096300:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bf4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5835:x1874598287127040:12345-0@lo:104: Request processed in 50us (2480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.096306:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787756339.096323:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787756339.096329:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096352:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af80031a00 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:0.0:1787756339.096356:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096364:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787756339.096370:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787756339.096376:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787756339.096406:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096413:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787756339.096429:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096436:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af80031a00/0x178386880caaafc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaafcf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096451:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787756339.096454:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096459:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2045e00 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:0.0:1787756339.096462:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096478:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787756339.096484:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787756339.096489:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787756339.096502:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096508:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787756339.096522:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096529:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc2045e00/0x178386880caaaf9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaafa5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.096540:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756339.096542:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756339.096543:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756339.096563:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287127552:0@lo:103: 00000100:00100000:0.0:1787756339.096597:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.096784:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89913840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287127680:0@lo:103: 00000100:00100000:0.0:1787756339.096809:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.096871:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287127552 00000100:00100000:0.0:1787756339.096876:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287127552 00010000:00010000:0.0:1787756339.096898:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af80030400/0x178386880caaafcf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaafc8 expref: 17 pid: 5836 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756339.096995:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287127680 00000100:00100000:0.0:1787756339.096999:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287127680 00010000:00010000:0.0:1787756339.097011:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98afc2045200/0x178386880caaafa5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf9e expref: 18 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756339.097022:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787756339.097028:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af899112c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:3310:x1874598287127552:12345-0@lo:103: 00010000:00010000:0.0:1787756339.097037:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756339.097042:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af80030400/0x178386880caaafcf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaafc8 expref: 18 pid: 5836 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.097051:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af80030400/0x178386880caaafcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaafc8 expref: 18 pid: 5836 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.097067:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756339.097208:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af899112c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:3310:x1874598287127552:12345-0@lo:103: Request processed in 179us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.097215:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787756339.097228:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787756339.097234:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89910b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:3311:x1874598287127680:12345-0@lo:103: 00010000:00010000:0.0:1787756339.097241:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756339.097246:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98afc2045200/0x178386880caaafa5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf9e expref: 17 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.097254:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98afc2045200/0x178386880caaafa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaaf9e expref: 17 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.097264:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756339.097296:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89910b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:3311:x1874598287127680:12345-0@lo:103: Request processed in 62us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.097303:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787756339.097337:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89913840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287127680:0@lo:103: 00000100:00100000:0.0:1787756339.097363:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287127552:0@lo:103: 00010000:00010000:2.0:1787756339.097514:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756339.097584:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af80030400/0x178386880caaafcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaafc8 expref: 16 pid: 5836 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.097596:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bed2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874598287126912:0@lo:104: 00010000:00010000:1.0:1787756339.097630:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afc2045200/0x178386880caaafa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaaf9e expref: 15 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.097639:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99becf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874598287127040:0@lo:104: 00000100:00100000:3.0:1787756339.098233:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.098255:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287127168 00000100:00100000:0.0:1787756339.098261:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287127168 00000100:00100000:0.0:1787756339.098286:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787756339.098292:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af88d93840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5835:x1874598287127168:12345-0@lo:104: 00010000:00010000:0.0:1787756339.098302:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.098388:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787756339.098394:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af88d93840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5835:x1874598287127168:12345-0@lo:104: Request processed in 102us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.098400:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787756339.098460:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756339.098539:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287127296 00000100:00100000:2.0:1787756339.098543:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287127296 00000100:00100000:2.0:1787756339.098562:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287127424 00000100:00100000:2.0:1787756339.098565:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287127424 00000100:00100000:2.0:1787756339.098578:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787756339.098583:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:5835:x1874598287127296:12345-0@lo:104: 00010000:00010000:2.0:1787756339.098591:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098638:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787756339.098644:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:5835:x1874598287127296:12345-0@lo:104: Request processed in 61us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756339.098650:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787756339.098676:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787756339.098689:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5835:x1874598287127424:12345-0@lo:104: 00010000:00010000:2.0:1787756339.098695:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098723:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787756339.098727:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5835:x1874598287127424:12345-0@lo:104: Request processed in 40us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756339.098733:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787756339.098766:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787756339.098772:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098780:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2044000 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756339.098784:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098792:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756339.098798:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756339.098805:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787756339.098830:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098861:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787756339.098874:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098901:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caaaf82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf89 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098920:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787756339.098923:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098930:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2044600 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756339.098933:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098939:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756339.098945:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756339.098950:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787756339.098963:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098969:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787756339.098978:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098985:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caaaf58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf5f expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.098993:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787756339.099001:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.099007:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af84da6000 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756339.099009:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.099016:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756339.099023:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756339.099028:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787756339.099041:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.099047:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787756339.099052:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.099059:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caaaf2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf35 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.099071:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756339.099072:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756339.099074:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756339.099095:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756339.099349:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287127936:0@lo:103: 00000100:00100000:0.0:1787756339.099384:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.099423:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787756339.099430:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287128064:0@lo:103: 00000100:00100000:0.0:1787756339.099450:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.099474:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287127936 00000100:00100000:0.0:1787756339.099478:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287127936 00010000:00010000:0.0:1787756339.099495:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af84da7400/0x178386880caaaf5f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf58 expref: 15 pid: 5837 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756339.099518:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287128064 00000100:00100000:0.0:1787756339.099520:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287128064 00010000:00010000:0.0:1787756339.099538:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af80030c00/0x178386880caaaf35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf2e expref: 16 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756339.099551:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787756339.099557:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89910f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:3309:x1874598287127936:12345-0@lo:103: 00010000:00010000:0.0:1787756339.099566:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756339.099571:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af84da7400/0x178386880caaaf5f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf58 expref: 16 pid: 5837 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.099580:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af84da7400/0x178386880caaaf5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaaf58 expref: 16 pid: 5837 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.099593:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756339.099634:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89910f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:3309:x1874598287127936:12345-0@lo:103: Request processed in 76us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.099641:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787756339.099653:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787756339.099659:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89913840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:3309:x1874598287128064:12345-0@lo:103: 00010000:00010000:0.0:1787756339.099666:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756339.099670:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af80030c00/0x178386880caaaf35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf2e expref: 15 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.099694:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af80030c00/0x178386880caaaf35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaaf2e expref: 15 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.099703:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756339.099724:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89913840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:3309:x1874598287128064:12345-0@lo:103: Request processed in 65us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.099730:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787756339.099773:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287127808:0@lo:103: 00000100:00100000:0.0:1787756339.099796:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.099849:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287128064:0@lo:103: 00000100:00100000:0.0:1787756339.099860:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287127936:0@lo:103: 00000100:00100000:0.0:1787756339.099882:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287127808 00000100:00100000:0.0:1787756339.099885:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287127808 00010000:00010000:0.0:1787756339.099909:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98afc2045000/0x178386880caaaf89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf82 expref: 15 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756339.100069:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787756339.100076:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89911a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:3312:x1874598287127808:12345-0@lo:103: 00010000:00010000:0.0:1787756339.100094:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756339.100098:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98afc2045000/0x178386880caaaf89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf82 expref: 15 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.100107:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98afc2045000/0x178386880caaaf89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaaf82 expref: 15 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.100119:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.100127:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.100140:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.100147:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.100164:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.100170:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.100176:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc21ce600 already unused, calling callback (ffffffffc162d530) 00010000:00010000:0.0:1787756339.100179:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.100187:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.100195:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.100204:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756339.100233:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89911a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:3312:x1874598287127808:12345-0@lo:103: Request processed in 158us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.100239:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787756339.100262:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287127808:0@lo:103: 00010000:00010000:1.0:1787756339.102566:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afc2045000/0x178386880caaaf89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaaf82 expref: 14 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.102586:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99beed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874598287127168:0@lo:104: 00010000:00010000:1.0:1787756339.102660:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da7400/0x178386880caaaf5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaaf58 expref: 13 pid: 5837 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.102671:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bef480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874598287127296:0@lo:104: 00010000:00010000:1.0:1787756339.102686:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af80030c00/0x178386880caaaf35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaaf2e expref: 12 pid: 5835 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.102698:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874598287127424:0@lo:104: 00010000:00010000:1.0:1787756339.102728:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.102809:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.102818:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.102824:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afc21ce600/0x178386880caaafe4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787756339.103018:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787756339.149332:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:7636:x1874598287126784:12345-0@lo:253: Request processed in 73495us (73903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756339.149347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787756339.149501:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287126784:0@lo:253: 10000000:01000000:1.0:1787756339.149516:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787756339.149519:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787756339.149521:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787756339.149522:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787756339.149523:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787756339.149525:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787756339.149526:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787756339.149527:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787756339.149529:0:7636:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787756339.149531:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787756339.149532:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787756339.149551:0:7636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff98af85ba0800 from lustre-OST0001 10000000:01000000:1.0:1787756339.149573:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787756339.149576:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787756339.149583:0:7636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff98af87ff1a48 local copy 10000000:01000000:1.0:1787756339.149587:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787756339.149683:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.149694:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.149703:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.149720:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128192:0@lo:101: 00000100:00100000:1.0:1787756339.149767:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756339.149812:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c693c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756339.149867:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287128192 00000100:00100000:2.0:1787756339.149873:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287128192 00000100:00100000:2.0:1787756339.149927:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787756339.149935:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+11:7636:x1874598287128192:12345-0@lo:101: 00010000:00010000:2.0:1787756339.149946:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756339.149958:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98afc2044600/0x178386880caaaff2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaafeb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.149977:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afc2044600/0x178386880caaaff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaafeb expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.149988:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98afc2044600/0x178386880caaaff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaafeb expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.149996:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2044600, rc 0) 00000100:00100000:2.0:1787756339.150033:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:7636:x1874598287128192:12345-0@lo:101: Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756339.150039:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787756339.150301:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128192:0@lo:101: 00010000:00010000:1.0:1787756339.150313:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.150334:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.150424:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128320:0@lo:501: 00000100:00100000:1.0:1787756339.150448:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756339.150476:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c693c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756339.150727:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287128320 00000100:00100000:2.0:1787756339.150731:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287128320 00000100:00100000:2.0:1787756339.150769:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787756339.150776:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:7636:x1874598287128320:12345-0@lo:501: 00000100:00100000:2.0:1787756339.151194:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:7636:x1874598287128320:12345-0@lo:501: Request processed in 417us (744us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787756339.151202:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787756339.151273:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128320:0@lo:501: 10000000:01000000:1.0:1787756339.151286:0:7636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787756339.151311:0:7636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787756339.151316:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.151325:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.151332:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.151351:0:7636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787756339.151369:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff98af85ba0800 10000000:01000000:1.0:1787756339.151373:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787756339.151377:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787756339.151380:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787756339.151384:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787756339.151386:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787756339.151402:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.151420:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.151429:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.151442:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128448:0@lo:101: 00000100:00100000:1.0:1787756339.151468:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756339.151493:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c69b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787756339.151547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287128448 00000100:00100000:3.0:1787756339.151552:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287128448 00000100:00100000:3.0:1787756339.151584:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787756339.151591:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:7636:x1874598287128448:12345-0@lo:101: 00010000:00010000:3.0:1787756339.151598:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756339.151618:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da6c00/0x178386880caab000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caaaff9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756339.151633:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da6c00/0x178386880caab000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caaaff9 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756339.151642:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da6c00/0x178386880caab000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaff9 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756339.151655:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da6c00, rc 0) 00000100:00100000:3.0:1787756339.151682:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287128448:12345-0@lo:101: Request processed in 91us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756339.151688:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787756339.151815:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128448:0@lo:101: 00010000:00010000:1.0:1787756339.151826:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.151863:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.152028:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128576:0@lo:501: 00000100:00100000:1.0:1787756339.152054:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756339.152071:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c69b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787756339.152183:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287128576 00000100:00100000:3.0:1787756339.152187:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287128576 00000100:00100000:3.0:1787756339.152217:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787756339.152223:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287128576:12345-0@lo:501: 00000100:00100000:3.0:1787756339.152378:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287128576:12345-0@lo:501: Request processed in 155us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756339.152385:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787756339.152457:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128576:0@lo:501: 00000100:00100000:1.0:1787756339.152484:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128704:0@lo:503: 00000100:00100000:1.0:1787756339.152518:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756339.152539:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c69b40 going to sleep for 11 seconds 00010000:00010000:2.0:1787756339.152595:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787756339.152602:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.152678:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc21ce600 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756339.152681:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.152688:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756339.152694:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756339.152699:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787756339.152720:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.152726:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787756339.152761:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.152768:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caaafeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x178386880caaaff2 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.152781:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756339.152782:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756339.152784:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756339.152791:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787756339.152801:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287128832:0@lo:103: 00000100:00100000:2.0:1787756339.152828:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756339.153009:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287128832 00000100:00100000:2.0:1787756339.153014:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287128832 00000100:00100000:2.0:1787756339.153052:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787756339.153059:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:3312:x1874598287128832:12345-0@lo:103: 00010000:00010000:2.0:1787756339.153069:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787756339.153189:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afc2044600/0x178386880caaaff2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x178386880caaafeb expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.153201:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787756339.153238:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:3312:x1874598287128832:12345-0@lo:103: Request processed in 179us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756339.153245:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787756339.153311:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287128704 00000100:00100000:3.0:1787756339.153315:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287128704 00000100:00100000:3.0:1787756339.153342:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787756339.153349:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:7636:x1874598287128704:12345-0@lo:503: 00000100:00100000:3.0:1787756339.153489:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:7636:x1874598287128704:12345-0@lo:503: Request processed in 140us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756339.153496:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787756339.153573:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287128832:0@lo:103: 00000100:00100000:1.0:1787756339.153600:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128704:0@lo:503: 00000040:00080000:1.0:1787756339.154177:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787756339.154254:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128960:0@lo:502: 00000100:00100000:1.0:1787756339.154293:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756339.154317:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af903e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756339.154477:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287128960 00000100:00100000:3.0:1787756339.154482:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287128960 00000100:00100000:3.0:1787756339.154513:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787756339.154520:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:7636:x1874598287128960:12345-0@lo:502: 00000100:00100000:3.0:1787756339.155069:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:7636:x1874598287128960:12345-0@lo:502: Request processed in 548us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756339.155257:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787756339.155351:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287128960:0@lo:502: 00000040:00080000:1.0:1787756339.155619:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787756339.155670:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787756339.155701:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787756339.155744:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787756339.155792:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787756339.155823:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787756339.155864:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129088:0@lo:502: 00000100:00100000:1.0:1787756339.155926:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756339.155960:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af903e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756339.156171:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287129088 00000100:00100000:3.0:1787756339.156183:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287129088 00000100:00100000:3.0:1787756339.156223:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787756339.156231:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:7636:x1874598287129088:12345-0@lo:502: 00000100:00100000:3.0:1787756339.156380:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:7636:x1874598287129088:12345-0@lo:502: Request processed in 148us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756339.156388:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787756339.156474:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129088:0@lo:502: 00000040:00080000:1.0:1787756339.156550:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787756339.156559:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787756339.160227:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787756339.160240:0:7644:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787756339.160246:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756339.160248:0:7644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787756339.160253:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787756339.160268:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff98afbb509a48) 00000020:00000080:0.0:1787756339.160290:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787756339.160296:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787756339.160366:0:7644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98af85ba0800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787756339.160373:0:7644:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787756339.160380:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x178386880caab00e 00010000:00010000:0.0:1787756339.165533:0:7644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787756339.166325:0:7644:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787756339.169342:0:7644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787756339.169586:0:7644:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787756339.175065:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787756339.176242:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787756339.178492:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787756339.178504:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787756339.178509:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756339.178511:0:7644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787756339.178515:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787756339.178519:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756339.178520:0:7644:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787756339.178523:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787756339.178525:0:7644:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787756339.178562:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787756339.178565:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756339.178567:0:7644:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787756339.178570:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787756339.180175:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787756339.180208:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787756339.180229:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.180242:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756339.180250:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98af85ba0800 from 1 10000000:01000000:1.0:1787756339.180259:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787756339.180292:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.180300:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.180311:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.180331:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129216:0@lo:101: 00000100:00100000:1.0:1787756339.180392:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756339.180431:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af85cfbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787756339.184617:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287129216 00000100:00100000:3.0:1787756339.184631:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287129216 00000100:00100000:3.0:1787756339.184716:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787756339.184726:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:7636:x1874598287129216:12345-0@lo:101: 00010000:00010000:3.0:1787756339.184741:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756339.184768:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da6800/0x178386880caab01c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab015 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756339.184793:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da6800/0x178386880caab01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab015 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756339.184805:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da6800/0x178386880caab01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab015 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756339.184821:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da6800, rc 0) 00000100:00100000:3.0:1787756339.184933:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287129216:12345-0@lo:101: Request processed in 208us (4540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756339.184940:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787756339.185033:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129216:0@lo:101: 00010000:00010000:0.0:1787756339.185050:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.185060:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756339.185189:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89912580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129344:0@lo:501: 00000100:00100000:0.0:1787756339.185221:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.186796:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc6540 going to sleep for 11 seconds 00000100:00100000:2.0:1787756339.187052:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287129344 00000100:00100000:2.0:1787756339.187059:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287129344 00000100:00100000:2.0:1787756339.187400:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787756339.187409:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287129344:12345-0@lo:501: 00000100:00100000:2.0:1787756339.187668:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287129344:12345-0@lo:501: Request processed in 259us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756339.187675:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787756339.187858:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89912580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129344:0@lo:501: 00000100:00100000:0.0:1787756339.187911:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89912580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129472:0@lo:503: 00000100:00100000:0.0:1787756339.187964:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.187989:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc6540 going to sleep for 11 seconds 00000100:00100000:2.0:1787756339.188233:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287129472 00000100:00100000:2.0:1787756339.188238:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287129472 00000100:00100000:2.0:1787756339.188259:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787756339.188266:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287129472:12345-0@lo:503: 00000100:00100000:2.0:1787756339.188531:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287129472:12345-0@lo:503: Request processed in 264us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756339.188538:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787756339.188572:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89912580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129472:0@lo:503: 00000040:00080000:2.0:1787756339.188828:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787756339.188911:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129600:0@lo:502: 00000100:00100000:2.0:1787756339.189066:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756339.189077:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa011c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756339.189108:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287129600 00000100:00100000:2.0:1787756339.189112:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287129600 00000100:00100000:2.0:1787756339.189129:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787756339.189136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287129600:12345-0@lo:502: 00000100:00100000:2.0:1787756339.189265:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287129600:12345-0@lo:502: Request processed in 128us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756339.189272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787756339.189300:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129600:0@lo:502: 00000040:00080000:2.0:1787756339.189523:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787756339.189567:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787756339.189589:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129728:0@lo:502: 00000100:00100000:2.0:1787756339.189621:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756339.189630:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c69cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756339.189647:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287129728 00000100:00100000:2.0:1787756339.189651:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287129728 00000100:00100000:2.0:1787756339.189667:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787756339.189673:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287129728:12345-0@lo:502: 00000100:00100000:2.0:1787756339.189786:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287129728:12345-0@lo:502: Request processed in 112us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756339.189793:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787756339.189823:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129728:0@lo:502: 00000040:00080000:2.0:1787756339.190135:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787756339.190146:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787756339.190765:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787756339.190775:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756339.190777:0:7648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787756339.190783:0:7648:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98af85ba0800 00000020:00000080:1.0:1787756339.190786:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787756339.190805:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787756339.190808:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756339.190809:0:7648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787756339.190812:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787756339.191252:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787756339.191275:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787756339.191338:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.191350:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756339.191390:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787756339.191393:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff98af85ba0800 10000000:01000000:2.0:1787756339.191396:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff98af85ba0800 10000000:01000000:2.0:1787756339.191400:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787756339.191405:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98af85ba0800 from 1 10000000:01000000:2.0:1787756339.191408:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787756339.191435:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.191444:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.191455:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756339.191473:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129856:0@lo:101: 00000100:00100000:2.0:1787756339.191518:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756339.191586:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c69cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756339.191648:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287129856 00000100:00100000:3.0:1787756339.191654:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287129856 00000100:00100000:3.0:1787756339.191726:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787756339.191735:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287129856:12345-0@lo:101: 00010000:00010000:3.0:1787756339.191745:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756339.191768:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da7400/0x178386880caab02a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab023 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756339.191788:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da7400/0x178386880caab02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab023 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756339.191798:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da7400/0x178386880caab02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab023 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756339.191807:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7400, rc 0) 00000100:00100000:3.0:1787756339.192072:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7636:x1874598287129856:12345-0@lo:101: Request processed in 337us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756339.192089:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787756339.192302:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129856:0@lo:101: 00010000:00010000:2.0:1787756339.192316:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.192326:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756339.192424:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129984:0@lo:501: 00000100:00100000:2.0:1787756339.192451:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756339.192514:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c69cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756339.192575:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287129984 00000100:00100000:0.0:1787756339.192580:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287129984 00000100:00100000:0.0:1787756339.192640:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787756339.192648:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7636:x1874598287129984:12345-0@lo:501: 00000100:00100000:0.0:1787756339.193419:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7636:x1874598287129984:12345-0@lo:501: Request processed in 769us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.193429:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787756339.193523:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287129984:0@lo:501: 00000100:00100000:2.0:1787756339.193554:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287130112:0@lo:503: 00000100:00100000:2.0:1787756339.193591:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756339.193645:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c69cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756339.193676:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287130112 00000100:00100000:0.0:1787756339.193681:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287130112 00000100:00100000:0.0:1787756339.193715:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787756339.193722:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7636:x1874598287130112:12345-0@lo:503: 00000100:00100000:0.0:1787756339.194177:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7636:x1874598287130112:12345-0@lo:503: Request processed in 454us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.194185:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787756339.194316:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287130112:0@lo:503: 00000040:00080000:2.0:1787756339.194554:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787756339.194611:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287130240:0@lo:502: 00000100:00100000:2.0:1787756339.194648:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756339.194707:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c69cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787756339.194739:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287130240 00000100:00100000:1.0:1787756339.194744:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287130240 00000100:00100000:1.0:1787756339.194819:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787756339.194827:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7636:x1874598287130240:12345-0@lo:502: 00000100:00100000:1.0:1787756339.195307:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7636:x1874598287130240:12345-0@lo:502: Request processed in 480us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756339.195314:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787756339.195497:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287130240:0@lo:502: 00000040:00080000:2.0:1787756339.195740:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787756339.195798:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787756339.195996:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787756339.196055:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787756339.196163:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787756339.196213:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787756339.196248:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787756339.196282:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787756339.196340:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787756339.196377:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787756339.196406:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787756339.196450:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787756339.196481:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787756339.196526:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787756339.196584:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787756339.196619:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787756339.196652:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787756339.196699:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787756339.196737:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787756339.196786:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787756339.196852:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787756339.196889:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787756339.197272:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787756339.197340:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787756339.197378:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787756339.197411:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787756339.197454:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787756339.197487:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787756339.197519:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787756339.197561:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787756339.197608:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787756339.197642:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787756339.197674:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787756339.197732:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787756339.197793:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787756339.198046:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787756339.198156:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787756339.198200:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287130368:0@lo:502: 00000100:00100000:2.0:1787756339.198265:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756339.198339:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa4c69cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756339.198627:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287130368 00000100:00100000:3.0:1787756339.198634:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287130368 00000100:00100000:3.0:1787756339.198723:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787756339.198732:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7636:x1874598287130368:12345-0@lo:502: 00000100:00100000:3.0:1787756339.199052:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7636:x1874598287130368:12345-0@lo:502: Request processed in 320us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756339.199065:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787756339.199276:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287130368:0@lo:502: 00000040:00080000:2.0:1787756339.199353:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787756339.199364:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787756339.199883:0:7649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787756339.199906:0:7649:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff98afbfcf8000) 00000020:00000080:1.0:1787756339.199939:0:7649:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1787756339.200004:0:7649:0:(tgt_mount.c:153:server_get_mount()) get mount ffff98af85ba0800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787756339.200009:0:7649:0:(tgt_mount.c:187:server_put_mount()) put mount ffff98af85ba0800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787756339.200012:0:7649:0:(obd_mount.c:710:lustre_put_lsi()) put ffff98af85ba0800 3 00010000:00080000:1.0:1787756339.200041:0:7649:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98af85ba6000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.121@tcp at head 00010000:00010000:1.0:1787756339.202339:0:7649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787756339.202559:0:7649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787756339.202595:0:7649:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787756339.202607:0:7649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x178386880caab038 00000100:00080000:1.0:1787756339.202617:0:7649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787756339.202622:0:7649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff98af85ba6000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1787756339.202654:0:7649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98af99bef480 x1874598287130496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787756339.202684:0:7649:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787756339.202764:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874598287130496:0@lo:38: 00000100:00100000:0.0:1787756339.202829:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.202929:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287130496 00000100:00100000:0.0:1787756339.202935:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287130496 00000100:00100000:0.0:1787756339.202963:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787756339.202969:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af899103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1874598287130496:12345-0@lo:38: 00010000:00080000:0.0:1787756339.202991:0:5842:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1787756339.203018:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x178386880caab03f 00000004:00100000:0.0:1787756339.203029:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787756339.203055:0:5842:0:(import.c:65:import_set_state_nolock()) ffff98af98257000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787756339.203214:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af899103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874598287130496:12345-0@lo:38: Request processed in 243us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.203222:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787756339.203257:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99bef480 x1874598287130496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787756349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756339.203267:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787756339.203274:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787756339.203280:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787756339.203284:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787756339.203287:0:3308:0:(import.c:65:import_set_state_nolock()) ffff98af85ba6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787756339.203302:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1874598287130496:0@lo:38: 00000100:00100000:0.0:1787756339.203493:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287130752:0@lo:400: 00000100:00100000:0.0:1787756339.203520:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.203540:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787756339.203545:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287130880:0@lo:400: 00000100:00100000:0.0:1787756339.203569:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.203612:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287130880 00000100:00100000:0.0:1787756339.203617:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287130880 00000100:00100000:0.0:1787756339.203654:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787756339.203660:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89912940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287130880:12345-0@lo:400: 00000100:00100000:0.0:1787756339.203696:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89912940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287130880:12345-0@lo:400: Request processed in 36us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.203703:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787756339.203718:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787756339.203736:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af899121c0 x1874598287130880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756339.203746:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287130880:0@lo:400: 00000100:00100000:1.0:1787756339.204011:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89913c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874598287130624:0@lo:400: 00000100:00100000:1.0:1787756339.204043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787756339.204251:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1787756339.204368:0:7650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99becf00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7650:1874598287131008:0@lo:901: 00000100:00100000:1.0:1787756339.204396:0:7650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756339.204424:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287131008 00000100:00100000:1.0:1787756339.204428:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287131008 00000100:00100000:1.0:1787756339.204460:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787756339.204467:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7650:x1874598287131008:12345-0@lo:901: 00000100:00100000:1.0:1787756339.204805:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7650:x1874598287131008:12345-0@lo:901: Request processed in 338us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756339.204813:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787756339.204829:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787756339.204862:0:7650:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af85cfbd80 going to sleep for 11 seconds 00010000:00080000:1.0:1787756339.204878:0:7650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af99becf00 x1874598287131008/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787756355 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756339.204889:0:7650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99becf00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7650:1874598287131008:0@lo:901: 00000100:00100000:0.0:1787756339.205252:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287130752 00000100:00100000:0.0:1787756339.205258:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287130752 00000100:00100000:0.0:1787756339.205297:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287130624 00000100:00100000:0.0:1787756339.205300:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287130624 00000100:00100000:0.0:1787756339.205313:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787756339.205319:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89911e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287130752:12345-0@lo:400: 00000100:00100000:0.0:1787756339.205362:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89911e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287130752:12345-0@lo:400: Request processed in 42us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.205368:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787756339.205380:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787756339.205392:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874598287130624:12345-0@lo:400: 00000100:00100000:0.0:1787756339.205436:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874598287130624:12345-0@lo:400: Request processed in 45us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.205443:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787756339.205473:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af89913480 x1874598287130752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756339.205484:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287130752:0@lo:400: 00010000:00080000:3.0:1787756339.205548:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff98af89913c00 x1874598287130624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756339.205559:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89913c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874598287130624:0@lo:400: 00000100:00080000:1.0:1787756339.205599:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1787756339.207216:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787756339.207251:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787756339.208176:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.208190:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787756339.208242:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787756339.208245:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787756339.208246:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787756339.208247:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787756339.208249:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787756339.208250:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787756339.208252:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787756339.208254:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787756339.208255:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787756339.208257:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787756339.208259:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787756339.208262:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787756339.208265:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787756339.208266:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787756339.208268:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787756339.208269:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787756339.208270:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787756339.208276:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787756339.208277:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787756339.208278:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787756339.208279:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787756339.208280:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787756339.208281:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787756339.208303:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787756339.208319:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89913480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287131136:0@lo:253: 00000100:00100000:0.0:1787756339.208379:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.208417:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756339.210634:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287131136 00000100:00100000:3.0:1787756339.210646:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287131136 00000100:00100000:3.0:1787756339.210703:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787756339.210713:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7636:x1874598287131136:12345-0@lo:253: 20000000:01000000:3.0:1787756339.210742:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787756339.210813:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787756339.247498:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787756339.247530:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787756339.247688:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787756339.247693:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787756339.247717:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.247734:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af84da7600/0x178386880caaaf97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf90 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.247743:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.247791:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af84da7600/0x178386880caaaf97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaaf90 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756339.247807:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af84da7600/0x178386880caaaf97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaaf90 expref: 14 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756339.247821:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874598287131264:0@lo:104: 00000100:00100000:0.0:1787756339.250055:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756339.250161:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287131264 00000100:00100000:2.0:1787756339.250170:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287131264 00000100:00100000:2.0:1787756339.250214:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787756339.250223:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89913c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5858:x1874598287131264:12345-0@lo:104: 00010000:00010000:2.0:1787756339.250238:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756339.250431:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af856cd180 going to sleep for 11 seconds 00010000:00010000:2.0:1787756339.251205:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787756339.251214:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89913c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:5858:x1874598287131264:12345-0@lo:104: Request processed in 991us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756339.251223:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787756339.251252:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787756339.251259:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.251267:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2044800 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756339.251271:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.251280:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756339.251287:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756339.251293:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787756339.251325:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.251332:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787756339.251709:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1874598287131264:0@lo:104: 00010000:00010000:0.0:1787756339.251730:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.251817:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.251825:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc2044800/0x178386880caaaf90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf97 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756339.251860:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756339.251863:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756339.251865:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756339.252202:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287131392:0@lo:103: 00000100:00100000:0.0:1787756339.252249:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756339.253102:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287131392 00000100:00100000:1.0:1787756339.253110:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287131392 00010000:00010000:1.0:1787756339.253139:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af84da7600/0x178386880caaaf97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf90 expref: 15 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756339.253176:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787756339.253184:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85b1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:3311:x1874598287131392:12345-0@lo:103: 00010000:00010000:1.0:1787756339.253195:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787756339.253200:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af84da7600/0x178386880caaaf97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf90 expref: 15 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253209:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af84da7600/0x178386880caaaf97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaaf90 expref: 15 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253225:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da7600/0x178386880caaaf97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaaf90 expref: 15 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253239:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253246:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787756339.253260:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005567317s 00010000:00010000:1.0:1787756339.253264:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253281:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253287:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253293:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253299:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af80031a00 already unused, calling callback (ffffffffc162d530) 00010000:00010000:1.0:1787756339.253302:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253310:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253323:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253332:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787756339.253665:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85b1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:3311:x1874598287131392:12345-0@lo:103: Request processed in 481us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756339.253673:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787756339.253721:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253730:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756339.253737:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af80031a00/0x178386880caab046 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756339.253902:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287131392:0@lo:103: 00000100:00100000:1.0:1787756339.262785:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:7636:x1874598287131136:12345-0@lo:253: Request processed in 52064us (54395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756339.262799:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787756339.263056:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89913480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7636:1874598287131136:0@lo:253: 10000000:01000000:0.0:1787756339.263070:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787756339.263074:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787756339.263075:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787756339.263140:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787756339.263143:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787756339.263144:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787756339.263146:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787756339.263147:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787756339.263149:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787756339.263150:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787756339.263152:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787756339.263153:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787756339.263168:0:7636:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787756339.269867:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787756339.270282:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787756339.271327:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787756339.271738:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787756339.272551:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787756339.274801:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787756339.278284:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1787756339.352595:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787756339.434730:0:7636:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787756339.434739:0:7636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787756339.434788:0:7636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787756339.435242:0:7636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787756339.435256:0:7636:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787756339.435284:0:7636:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1787756339.736320:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287131520:0@lo:13: 00000100:00100000:1.0:1787756339.736386:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756339.737027:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287131520 00000100:00100000:0.0:1787756339.737035:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287131520 00000100:00100000:0.0:1787756339.737086:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787756339.737094:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99becf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287131520:12345-0@lo:13: 00002000:00000024:0.0:1787756339.737127:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756339.738409:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99becf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287131520:12345-0@lo:13: Request processed in 1311us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756339.738429:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787756339.738541:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba6940 x1874598287131520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756339.738563:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287131520:0@lo:13: 00010000:00010000:2.0:1787756340.376001:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756341.400043:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756342.426016:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756343.447967:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756344.350078:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287131648:0@lo:400: 00000100:00100000:2.0:1787756344.350151:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756344.350194:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287132160:0@lo:400: 00000100:00100000:2.0:1787756344.350220:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756344.350242:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787756344.350247:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287131776:0@lo:400: 00000100:00100000:2.0:1787756344.350266:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756344.350292:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287131904:0@lo:400: 00000100:00100000:2.0:1787756344.350320:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756344.350338:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787756344.350344:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287132032:0@lo:400: 00000100:00100000:2.0:1787756344.350366:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756344.350396:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287131648 00000100:00100000:2.0:1787756344.350403:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287131648 00000100:00100000:2.0:1787756344.350439:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787756344.350447:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:3309:x1874598287131648:12345-0@lo:400: 00000100:00100000:2.0:1787756344.350489:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:3309:x1874598287131648:12345-0@lo:400: Request processed in 42us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756344.350496:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787756344.350524:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287132160 00000100:00100000:2.0:1787756344.350527:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287132160 00000100:00100000:2.0:1787756344.350552:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287131776 00000100:00100000:2.0:1787756344.350556:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287131776 00000100:00100000:2.0:1787756344.350565:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287131904 00000100:00100000:2.0:1787756344.350567:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287131904 00000100:00100000:2.0:1787756344.350579:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787756344.350584:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287132160:12345-0@lo:400: 00000100:00100000:2.0:1787756344.350612:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287132160:12345-0@lo:400: Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756344.350618:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787756344.350628:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787756344.350634:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287131776:12345-0@lo:400: 00000100:00100000:2.0:1787756344.350657:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287131776:12345-0@lo:400: Request processed in 23us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756344.350662:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787756344.350672:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787756344.350683:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287131904:12345-0@lo:400: 00000100:00100000:2.0:1787756344.350726:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287131904:12345-0@lo:400: Request processed in 32us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756344.350731:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787756344.350753:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287132032 00000100:00100000:2.0:1787756344.350756:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287132032 00000100:00100000:2.0:1787756344.350791:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787756344.350798:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287132032:12345-0@lo:400: 00000100:00100000:2.0:1787756344.350826:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287132032:12345-0@lo:400: Request processed in 30us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756344.350853:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787756344.350867:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787756344.350871:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787756344.350896:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca0f00 x1874598287132032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756344.350908:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287132032:0@lo:400: 00010000:00080000:2.0:1787756344.350918:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca21c0 x1874598287131904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756344.350926:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287131904:0@lo:400: 00010000:00080000:2.0:1787756344.350951:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca1e00 x1874598287131776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756344.350960:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287131776:0@lo:400: 00000100:00100000:2.0:1787756344.350968:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287131648:0@lo:400: 00010000:00080000:2.0:1787756344.350975:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca12c0 x1874598287132160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756344.350995:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287132160:0@lo:400: 00010000:00010000:3.0:1787756344.472490:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756344.858424:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287132288:0@lo:13: 00000100:00100000:2.0:1787756344.858540:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756344.858850:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287132288 00000100:00100000:1.0:1787756344.858857:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287132288 00000100:00100000:1.0:1787756344.858901:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787756344.858910:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287132288:12345-0@lo:13: 00002000:00000024:1.0:1787756344.858942:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1787756344.860038:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99befc00 x1874598287132288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756344.860064:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287132288:0@lo:13: 10000000:01000000:0.0:1787756344.861218:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787756344.861223:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98afb3fb3800 from 30 10000000:01000000:0.0:1787756344.861228:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787756344.861268:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.861287:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.861298:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756344.861317:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287132416:0@lo:101: 00000100:00100000:0.0:1787756344.861373:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756344.861411:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae821d3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787756344.861938:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287132416 00000100:00100000:0.0:1787756344.861946:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287132416 00000100:00100000:0.0:1787756344.861995:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787756344.862004:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287132416:12345-0@lo:101: 00010000:00010000:0.0:1787756344.862030:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756344.862044:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af80030a00/0x178386880caab054 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab04d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.862080:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af80030a00/0x178386880caab054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab04d expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.862091:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af80030a00/0x178386880caab054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab04d expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.862100:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af80030a00, rc 0) 00000100:00100000:0.0:1787756344.862145:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287132416:12345-0@lo:101: Request processed in 142us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756344.862151:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787756344.862197:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287132416:0@lo:101: 00010000:00010000:0.0:1787756344.862216:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.862224:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756344.862277:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287132544:0@lo:501: 00000100:00100000:0.0:1787756344.862305:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756344.862320:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae821d3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787756344.862334:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287132544 00000100:00100000:0.0:1787756344.862337:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287132544 00000100:00100000:0.0:1787756344.862358:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787756344.862364:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287132544:12345-0@lo:501: 00000100:00100000:0.0:1787756344.862688:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287132544:12345-0@lo:501: Request processed in 322us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756344.862696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787756344.862744:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287132544:0@lo:501: 00000100:00100000:0.0:1787756344.862772:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287132672:0@lo:503: 00000100:00100000:0.0:1787756344.862809:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756344.863333:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae821d3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787756344.863351:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287132672 00000100:00100000:0.0:1787756344.863355:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287132672 00000100:00100000:0.0:1787756344.863383:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787756344.863391:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287132672:12345-0@lo:503: 00000100:00100000:0.0:1787756344.863668:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287132672:12345-0@lo:503: Request processed in 276us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756344.863675:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787756344.863889:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287132288:12345-0@lo:13: Request processed in 1234us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756344.863900:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787756344.864304:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287132672:0@lo:503: 00000100:00100000:1.0:1787756344.868369:0:7957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7957:1874598287132800:0@lo:502: 00000100:00100000:1.0:1787756344.869419:0:7957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756344.869457:0:7957:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa011c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787756344.870800:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287132800 00000100:00100000:0.0:1787756344.870810:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287132800 00000100:00100000:0.0:1787756344.870865:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787756344.870874:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7957:x1874598287132800:12345-0@lo:502: 00000100:00100000:0.0:1787756344.871188:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7957:x1874598287132800:12345-0@lo:502: Request processed in 315us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756344.871196:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787756344.871235:0:7957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7957:1874598287132800:0@lo:502: 00000100:00100000:1.0:1787756344.871333:0:7957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7957:1874598287132928:0@lo:502: 00000100:00100000:1.0:1787756344.871403:0:7957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756344.871434:0:7957:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afa011c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787756344.871454:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287132928 00000100:00100000:0.0:1787756344.871459:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287132928 00000100:00100000:0.0:1787756344.871491:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787756344.871498:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7957:x1874598287132928:12345-0@lo:502: 00000100:00100000:0.0:1787756344.871630:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:7957:x1874598287132928:12345-0@lo:502: Request processed in 132us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756344.871636:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787756344.873361:0:7957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7957:1874598287132928:0@lo:502: 00000040:00080000:1.0:1787756344.873875:0:7957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787756344.875054:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787756344.875079:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787756344.875089:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756344.875101:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787756344.875111:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787756344.875114:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787756344.875117:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787756344.875150:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756344.875158:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756344.875178:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756344.875198:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133056:0@lo:101: 00000100:00100000:3.0:1787756344.875259:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756344.875305:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc5600 going to sleep for 11 seconds 00000100:00100000:1.0:1787756344.876882:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287133056 00000100:00100000:1.0:1787756344.876893:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287133056 00000100:00100000:1.0:1787756344.876942:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787756344.876952:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287133056:12345-0@lo:101: 00010000:00010000:1.0:1787756344.876977:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787756344.876992:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98afb3845000/0x178386880caab062 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab05b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756344.877053:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afb3845000/0x178386880caab062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab05b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756344.877065:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98afb3845000/0x178386880caab062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab05b expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756344.877073:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afb3845000, rc 0) 00000100:00100000:1.0:1787756344.877138:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287133056:12345-0@lo:101: Request processed in 187us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756344.877155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787756344.877161:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133056:0@lo:101: 00010000:00010000:3.0:1787756344.877178:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756344.877187:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756344.877242:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133184:0@lo:501: 00000100:00100000:3.0:1787756344.877274:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756344.877305:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc5600 going to sleep for 11 seconds 00000100:00100000:1.0:1787756344.877356:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287133184 00000100:00100000:1.0:1787756344.877360:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287133184 00000100:00100000:1.0:1787756344.877413:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787756344.877420:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287133184:12345-0@lo:501: 00000100:00100000:1.0:1787756344.877854:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287133184:12345-0@lo:501: Request processed in 414us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756344.877862:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787756344.877866:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133184:0@lo:501: 00000100:00100000:3.0:1787756344.877906:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133312:0@lo:503: 00000100:00100000:3.0:1787756344.877944:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756344.877969:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc5600 going to sleep for 11 seconds 00000100:00100000:1.0:1787756344.878070:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287133312 00000100:00100000:1.0:1787756344.878089:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287133312 00000100:00100000:1.0:1787756344.878132:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787756344.878348:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287133312:12345-0@lo:503: 00000100:00100000:1.0:1787756344.878891:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287133312:12345-0@lo:503: Request processed in 559us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756344.878899:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787756344.878941:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133312:0@lo:503: 00000100:00100000:3.0:1787756344.880529:0:7959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7959:1874598287133440:0@lo:502: 00000100:00100000:3.0:1787756344.880588:0:7959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756344.880658:0:7959:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756344.880696:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287133440 00000100:00100000:0.0:1787756344.880702:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287133440 00000100:00100000:0.0:1787756344.880780:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787756344.880789:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:7959:x1874598287133440:12345-0@lo:502: 00000100:00100000:2.0:1787756344.881305:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:7959:x1874598287133440:12345-0@lo:502: Request processed in 516us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756344.881313:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787756344.881386:0:7959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7959:1874598287133440:0@lo:502: 00000020:01000000:0.0:1787756344.881418:0:7959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787756344.881427:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756344.881430:0:7959:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787756344.881435:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787756344.881437:0:7959:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787756344.881455:0:7959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7959:1874598287133568:0@lo:502: 00000100:00100000:0.0:1787756344.881494:0:7959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756344.881661:0:7959:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae821d33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756344.881690:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287133568 00000100:00100000:3.0:1787756344.881696:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287133568 00000100:00100000:2.0:1787756344.881811:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787756344.881829:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:7959:x1874598287133568:12345-0@lo:502: 00000100:00100000:2.0:1787756344.882102:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:7959:x1874598287133568:12345-0@lo:502: Request processed in 283us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756344.882109:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787756344.882318:0:7959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7959:1874598287133568:0@lo:502: 00000020:01000000:0.0:1787756344.882342:0:7959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787756344.882347:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787756344.882349:0:7959:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787756344.882353:0:7959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787756344.882492:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787756344.882508:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787756344.882517:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756344.882528:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787756344.882536:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787756344.882538:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98af903a6800 from 30 10000000:01000000:3.0:1787756344.882541:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787756344.882565:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756344.882573:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756344.882582:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756344.882597:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133696:0@lo:101: 00000100:00100000:3.0:1787756344.882627:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756344.882659:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756344.882701:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287133696 00000100:00100000:0.0:1787756344.882706:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287133696 00000100:00100000:0.0:1787756344.882747:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787756344.882754:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287133696:12345-0@lo:101: 00010000:00010000:0.0:1787756344.882763:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756344.882774:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af80031a00/0x178386880caab070 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab069 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.882794:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af80031a00/0x178386880caab070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab069 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.882805:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af80031a00/0x178386880caab070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab069 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.882814:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af80031a00, rc 0) 00000100:00100000:0.0:1787756344.883009:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287133696:12345-0@lo:101: Request processed in 255us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756344.883074:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787756344.883482:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133696:0@lo:101: 00010000:00010000:3.0:1787756344.883497:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756344.883506:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756344.883563:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133824:0@lo:501: 00000100:00100000:3.0:1787756344.883595:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756344.883726:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756344.883795:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287133824 00000100:00100000:0.0:1787756344.883800:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287133824 00000100:00100000:0.0:1787756344.884014:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787756344.884080:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287133824:12345-0@lo:501: 00000100:00100000:0.0:1787756344.884316:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287133824:12345-0@lo:501: Request processed in 238us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756344.884329:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787756344.884410:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133824:0@lo:501: 00000100:00100000:3.0:1787756344.884440:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133952:0@lo:503: 00000100:00100000:3.0:1787756344.884480:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756344.884509:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756344.884560:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287133952 00000100:00100000:0.0:1787756344.884565:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287133952 00000100:00100000:0.0:1787756344.884594:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787756344.884601:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287133952:12345-0@lo:503: 00000100:00100000:0.0:1787756344.884742:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287133952:12345-0@lo:503: Request processed in 140us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756344.884748:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787756344.885071:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287133952:0@lo:503: 00000100:00100000:2.0:1787756344.886173:0:7961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7961:1874598287134080:0@lo:502: 00000100:00100000:2.0:1787756344.886229:0:7961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756344.886268:0:7961:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae81d96840 going to sleep for 11 seconds 00000100:00100000:3.0:1787756344.886316:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287134080 00000100:00100000:3.0:1787756344.886321:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287134080 00000100:00100000:3.0:1787756344.886360:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787756344.886368:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:7961:x1874598287134080:12345-0@lo:502: 00000100:00100000:3.0:1787756344.886565:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:7961:x1874598287134080:12345-0@lo:502: Request processed in 197us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756344.886571:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787756344.886616:0:7961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7961:1874598287134080:0@lo:502: 00000100:00100000:3.0:1787756344.886661:0:7961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7961:1874598287134208:0@lo:502: 00000100:00100000:3.0:1787756344.886694:0:7961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756344.886707:0:7961:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787756344.886766:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287134208 00000100:00100000:2.0:1787756344.886770:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287134208 00000100:00100000:2.0:1787756344.886799:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787756344.886806:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:7961:x1874598287134208:12345-0@lo:502: 00000100:00100000:2.0:1787756344.887088:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:7961:x1874598287134208:12345-0@lo:502: Request processed in 282us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756344.887095:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787756344.887214:0:7961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7961:1874598287134208:0@lo:502: 00000040:00080000:3.0:1787756344.887237:0:7961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787756344.887513:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787756344.887530:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787756344.887538:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756344.887549:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756344.887559:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787756344.887561:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff98af903a6800 from 5 10000000:01000000:2.0:1787756344.887563:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787756344.887590:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2045c00/0x178386880caab077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756344.887598:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc2045c00/0x178386880caab077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756344.887607:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc2045c00/0x178386880caab077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756344.887620:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287134336:0@lo:101: 00000100:00100000:2.0:1787756344.887649:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756344.887704:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae81d96780 going to sleep for 11 seconds 00000100:00100000:3.0:1787756344.887742:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287134336 00000100:00100000:3.0:1787756344.887747:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287134336 00000100:00100000:3.0:1787756344.887808:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787756344.887815:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287134336:12345-0@lo:101: 00010000:00010000:3.0:1787756344.887851:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756344.887864:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da7800/0x178386880caab07e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab077 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756344.887892:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da7800/0x178386880caab07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab077 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756344.887902:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da7800/0x178386880caab07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab077 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756344.887909:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7800, rc 0) 00000100:00100000:3.0:1787756344.887944:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287134336:12345-0@lo:101: Request processed in 129us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756344.887949:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787756344.888043:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287134336:0@lo:101: 00010000:00010000:0.0:1787756344.888068:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc2045c00/0x178386880caab077 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab07e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.888077:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc2045c00/0x178386880caab077 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab07e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756344.888120:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287134464:0@lo:256: 00000100:00100000:0.0:1787756344.888150:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756344.888677:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae821d3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787756344.888707:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287134464 00000100:00100000:2.0:1787756344.888720:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287134464 00000100:00100000:2.0:1787756344.888744:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787756344.888751:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287134464:12345-0@lo:256: 20000000:01000000:2.0:1787756344.888764:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787756344.888782:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787756344.888785:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787756344.889120:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287134464:12345-0@lo:256: Request processed in 368us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756344.889127:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787756344.889185:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287134464:0@lo:256: 10000000:01000000:0.0:1787756344.889228:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787756344.889235:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2045c00/0x178386880caab077 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab07e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.889243:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc2045c00/0x178386880caab077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab07e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787756344.889251:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787756344.889258:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787756344.889261:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787756344.889283:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.889291:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.889299:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756344.889312:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287134592:0@lo:101: 00000100:00100000:0.0:1787756344.889339:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756344.889398:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae821d3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787756344.889439:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287134592 00000100:00100000:3.0:1787756344.889444:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287134592 00000100:00100000:2.0:1787756344.889480:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787756344.889488:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287134592:12345-0@lo:101: 00010000:00010000:2.0:1787756344.889495:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756344.889505:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98afc2045e00/0x178386880caab08c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab085 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756344.889521:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afc2045e00/0x178386880caab08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab085 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756344.889530:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98afc2045e00/0x178386880caab08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab085 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756344.889538:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2045e00, rc 0) 00000100:00100000:2.0:1787756344.889611:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287134592:12345-0@lo:101: Request processed in 123us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756344.889616:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787756344.889732:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287134592:0@lo:101: 00010000:00010000:0.0:1787756344.889743:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756344.889751:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756344.889793:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287134720:0@lo:501: 00000100:00100000:0.0:1787756344.889818:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756344.896317:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae821d3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787756344.896596:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287134720 00000100:00100000:3.0:1787756344.896606:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287134720 00000100:00100000:3.0:1787756344.896658:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787756344.896668:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287134720:12345-0@lo:501: 00000100:00100000:3.0:1787756344.897009:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287134720:12345-0@lo:501: Request processed in 342us (7188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756344.897017:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787756344.897073:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287134720:0@lo:501: 00000100:00100000:3.0:1787756344.897122:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287134848:0@lo:503: 00000100:00100000:3.0:1787756344.897165:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756344.897194:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc5600 going to sleep for 11 seconds 00000100:00100000:3.0:1787756344.897208:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287134848 00000100:00100000:3.0:1787756344.897212:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287134848 00000100:00100000:3.0:1787756344.897236:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787756344.897243:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287134848:12345-0@lo:503: 00000100:00100000:3.0:1787756344.897511:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287134848:12345-0@lo:503: Request processed in 267us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756344.897518:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787756344.897558:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287134848:0@lo:503: 00000100:00100000:3.0:1787756344.897744:0:7963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7963:1874598287134976:0@lo:502: 00000100:00100000:3.0:1787756344.897782:0:7963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756344.897801:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287134976 00000100:00100000:3.0:1787756344.897805:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287134976 00000100:00100000:3.0:1787756344.897829:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787756344.897855:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:7963:x1874598287134976:12345-0@lo:502: 00000100:00100000:3.0:1787756344.898053:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:7963:x1874598287134976:12345-0@lo:502: Request processed in 198us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756344.898061:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787756344.898089:0:7963:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787756344.898101:0:7963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7963:1874598287134976:0@lo:502: 00000020:01000000:3.0:1787756344.898126:0:7963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787756344.898134:0:7963:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787756344.898140:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756344.898142:0:7963:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787756344.898147:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787756344.898151:0:7963:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.121@tcp to nid 0x20000c0a8cb79 (192.168.203.121@tcp) 00000020:01000000:3.0:1787756344.898171:0:7963:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787756344.898179:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787756344.898192:0:7963:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff98af85c8b490) 00000020:00000080:3.0:1787756344.898212:0:7963:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787756344.898218:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787756344.898284:0:7963:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787756344.898289:0:7963:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787756344.898296:0:7963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x178386880caab09a 00010000:00080000:3.0:1787756344.898322:0:7963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff98af8a300000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.121@tcp at head 00010000:00010000:3.0:1787756344.898548:0:7963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787756344.898862:0:7963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787756344.898873:0:7963:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787756344.899366:0:7963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787756344.899624:0:7963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787756344.899673:0:7963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787756344.907115:0:7963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787756344.907960:0:7964:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787756344.907966:0:7964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787756344.912486:0:7963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787756344.912502:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787756344.912539:0:7963:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787756344.912561:0:7963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x178386880caab0a1 00000100:00080000:1.0:1787756344.912572:0:7963:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787756344.912578:0:7963:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff98af8a300000 using connection 192.168.203.121@tcp/0@lo 00000100:00100000:1.0:1787756344.912614:0:7963:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff98af99beda40 x1874598287135104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787756344.912642:0:7963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787756344.912736:0:7963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787756344.912741:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756344.912743:0:7963:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787756344.912747:0:7963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787756344.912751:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756344.912752:0:7963:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787756344.912754:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787756344.912756:0:7963:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787756344.912783:0:7963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7963:1874598287135232:0@lo:502: 00000100:00100000:1.0:1787756344.913009:0:7963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756344.913057:0:7963:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9029d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756344.913109:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287135232 00000100:00100000:3.0:1787756344.913115:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287135232 00000100:00100000:3.0:1787756344.913162:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787756344.913170:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:7963:x1874598287135232:12345-0@lo:502: 00000100:00100000:3.0:1787756344.913391:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:7963:x1874598287135232:12345-0@lo:502: Request processed in 220us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756344.913398:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787756344.913489:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874598287135104:0@lo:8: 00000100:00100000:0.0:1787756344.913526:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756344.913564:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287135104 00000100:00100000:0.0:1787756344.913568:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287135104 00000100:00100000:0.0:1787756344.913591:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787756344.913596:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89912580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1874598287135104:12345-0@lo:8: 00010000:00080000:0.0:1787756344.913624:0:6692:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1787756344.913648:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x178386880caab0a8 00002000:00100000:0.0:1787756344.913660:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff98af98257800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787756344.913665:0:6692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787756344.913668:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787756344.913787:0:6692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787756344.914011:0:6692:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787756344.914034:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98af98250000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787756344.914069:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89912580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1874598287135104:12345-0@lo:8: Request processed in 472us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756344.914076:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787756344.914109:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99beda40 x1874598287135104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787756354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756344.914118:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787756344.914124:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787756344.914129:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787756344.914133:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787756344.914136:0:3308:0:(import.c:65:import_set_state_nolock()) ffff98af8a300000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787756344.914144:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787756344.914149:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1874598287135104:0@lo:8: 00000004:00080000:3.0:1787756344.914679:0:7964:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787756344.914785:0:7964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 203802951001ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787756344.915178:0:7963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:7963:1874598287135232:0@lo:502: 00000020:01000000:1.0:1787756344.915214:0:7963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787756344.915220:0:7963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756344.915223:0:7963:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787756344.915227:0:7963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1787756344.915279:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787756344.915294:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787756344.915303:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756344.915313:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756344.915335:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787756344.915338:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98af87ff1a48 from 1 10000000:01000000:1.0:1787756344.915341:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787756344.915371:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756344.915381:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756344.915389:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756344.915404:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287135360:0@lo:101: 00000100:00100000:1.0:1787756344.915447:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756344.915476:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9029d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787756344.915491:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287135360 00000100:00100000:1.0:1787756344.915504:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287135360 00000100:00100000:1.0:1787756344.915535:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787756344.915543:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287135360:12345-0@lo:101: 00010000:00010000:1.0:1787756344.915552:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787756344.915563:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98afb3845800/0x178386880caab0b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab0af expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756344.915584:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afb3845800/0x178386880caab0b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab0af expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756344.915593:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98afb3845800/0x178386880caab0b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab0af expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756344.915602:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afb3845800, rc 0) 00000100:00100000:1.0:1787756344.915634:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287135360:12345-0@lo:101: Request processed in 92us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756344.915640:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787756344.915673:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287135360:0@lo:101: 00010000:00010000:1.0:1787756344.915685:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756344.915694:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756344.915745:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287135488:0@lo:501: 00000100:00100000:1.0:1787756344.915770:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756344.915784:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9029d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787756344.915796:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287135488 00000100:00100000:1.0:1787756344.915799:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287135488 00000100:00100000:1.0:1787756344.915828:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787756344.915855:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287135488:12345-0@lo:501: 00000100:00100000:1.0:1787756344.916042:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287135488:12345-0@lo:501: Request processed in 207us (271us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787756344.916050:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787756344.916079:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287135488:0@lo:501: 10000000:01000000:1.0:1787756344.916097:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787756344.916102:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756344.916108:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787756344.987873:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787756344.991776:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287135616:0@lo:13: 00000100:00100000:1.0:1787756344.991946:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756344.992021:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287135616 00000100:00100000:1.0:1787756344.992029:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287135616 00000100:00100000:1.0:1787756344.992079:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787756344.992088:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874598287135616:12345-0@lo:13: 00002000:00000024:1.0:1787756344.992121:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787756344.992165:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874598287135616:12345-0@lo:13: Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756344.992172:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787756344.992192:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787756344.992219:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99befc00 x1874598287135616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756344.992238:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287135616:0@lo:13: 00000004:00080000:1.0:1787756344.992264:0:7965:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787756344.992284:0:7965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1874598287135744:0@lo:7: 00000100:00100000:1.0:1787756344.992310:0:7965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756344.992333:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287135744 00000100:00100000:1.0:1787756344.992337:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287135744 00000100:00100000:1.0:1787756344.992362:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787756344.992368:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7965:x1874598287135744:12345-0@lo:7: 00000100:00100000:0.0:1787756344.995103:0:7965:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9029d6c0 going to sleep for 11 seconds 00002000:00080000:1.0:1787756345.002219:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787756345.002227:0:6690:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787756345.002319:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7965:x1874598287135744:12345-0@lo:7: Request processed in 9946us (10002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756345.002330:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787756345.002823:0:7965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99befc00 x1874598287135744/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787756360 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756345.002864:0:7965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99befc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1874598287135744:0@lo:7: 00000004:00080000:0.0:1787756345.002887:0:7965:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787756345.002936:0:7965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1874598287135872:0@lo:5: 00000100:00100000:0.0:1787756345.002979:0:7965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756345.003025:0:7965:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae821d3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787756345.005309:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287135872 00000100:00100000:1.0:1787756345.005321:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287135872 00000100:00100000:1.0:1787756345.005388:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787756345.005397:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7965:x1874598287135872:12345-0@lo:5: 00002000:00080000:1.0:1787756345.005427:0:6693:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787756345.005431:0:6693:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787756345.006343:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7965:x1874598287135872:12345-0@lo:5: Request processed in 944us (3359us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787756345.006352:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787756345.006454:0:7965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af899121c0 x1874598287135872/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787756361 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756345.006472:0:7965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1874598287135872:0@lo:5: 00000004:00080000:3.0:1787756345.006497:0:7965:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787756345.006533:0:7965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1874598287136000:0@lo:700: 00000100:00100000:3.0:1787756345.006568:0:7965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756345.006603:0:7965:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af85ab0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787756345.006663:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287136000 00000100:00100000:1.0:1787756345.006668:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287136000 00000100:00100000:1.0:1787756345.006706:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787756345.006724:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7965:x1874598287136000:12345-0@lo:700: 00000100:00100000:1.0:1787756345.006753:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bed680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1874598287136128:0@lo:700: 00000100:00100000:1.0:1787756345.006781:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756345.006806:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9029de40 going to sleep for 11 seconds 00000100:00100000:1.0:1787756345.006853:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287136128 00000100:00100000:1.0:1787756345.006857:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287136128 00000100:00100000:1.0:1787756345.007041:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787756345.007050:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1874598287136128:12345-0@lo:700: 40000000:02000000:0.0:1787756345.066479:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787756345.081433:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1874598287136128:12345-0@lo:700: Request processed in 74377us (74643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756345.081447:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787756345.081788:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99bed680 x1874598287136128/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787756361 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756345.081804:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bed680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1874598287136128:0@lo:700: 40000000:02000000:0.0:1787756345.081818:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1787756345.185897:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7965:x1874598287136000:12345-0@lo:700: Request processed in 179167us (179320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756345.185911:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:3.0:1787756345.187761:0:7654:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787756345.187781:0:7654:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:3.0:1787756345.187853:0:7965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba5a40 x1874598287136000/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787756361 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756345.187870:0:7965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1874598287136000:0@lo:700: 00000004:02000040:3.0:1787756345.249817:0:7965:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787756345.259313:0:7965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1874598287136256:0@lo:5: 00000100:00100000:3.0:1787756345.259594:0:7965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756345.259700:0:7965:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9e0eba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787756345.260944:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287136256 00000100:00100000:2.0:1787756345.260955:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287136256 00000100:00100000:2.0:1787756345.261115:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787756345.261125:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7965:x1874598287136256:12345-0@lo:5: 00000001:02000400:2.0:1787756345.288210:0:8002:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00002000:00080000:3.0:1787756345.289727:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787756345.289748:0:6690:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787756345.297785:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7965:x1874598287136256:12345-0@lo:5: Request processed in 36654us (38393us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787756345.297801:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787756345.297882:0:7965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba5a40 x1874598287136256/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787756361 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756345.297895:0:7965:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787756345.297911:0:7965:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff98ae81ba5a40 x1874598287136256/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787756361 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756345.297923:0:7965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7965:1874598287136256:0@lo:5: 00000004:00080000:3.0:1787756345.297938:0:7965:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787756345.497170:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756346.520177:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756347.543995:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756348.569072:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787756349.583412:0:7654:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787756349.592375:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756349.976464:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287136384:0@lo:400: 00000100:00100000:1.0:1787756349.976530:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756349.976572:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287136896:0@lo:400: 00000100:00100000:1.0:1787756349.976595:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756349.976620:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787756349.976626:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287136768:0@lo:400: 00000100:00100000:1.0:1787756349.976649:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756349.976691:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287136384 00000100:00100000:1.0:1787756349.976698:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287136384 00000100:00100000:1.0:1787756349.976738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787756349.976746:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287136384:12345-0@lo:400: 00000100:00100000:1.0:1787756349.976790:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287136384:12345-0@lo:400: Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756349.976797:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787756349.976827:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287136768 00000100:00100000:1.0:1787756349.976830:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287136768 00000100:00100000:1.0:1787756349.976896:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787756349.976903:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287136768:12345-0@lo:400: 00000100:00100000:1.0:1787756349.976940:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287136768:12345-0@lo:400: Request processed in 38us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756349.977012:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787756349.977033:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787756349.977129:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99beda40 x1874598287136768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756349.977143:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287136768:0@lo:400: 00000100:00100000:1.0:1787756349.977153:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287136384:0@lo:400: 00000100:00100000:1.0:1787756349.977376:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287136512:0@lo:400: 00000100:00100000:1.0:1787756349.977407:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756349.977428:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287137024:0@lo:400: 00000100:00100000:1.0:1787756349.977447:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756349.977468:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787756349.977473:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287136640:0@lo:400: 00000100:00100000:1.0:1787756349.977492:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756349.977701:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287137024 00000100:00100000:3.0:1787756349.977706:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287137024 00000100:00100000:3.0:1787756349.977736:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787756349.977743:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287137024:12345-0@lo:400: 00000100:00100000:3.0:1787756349.977780:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287137024:12345-0@lo:400: Request processed in 37us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756349.977786:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787756349.977892:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787756349.977912:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c630c0 x1874598287137024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756349.977921:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787756349.977932:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287137024:0@lo:400: 00000100:00100000:3.0:1787756349.979165:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287136896 00000100:00100000:3.0:1787756349.979173:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287136896 00000100:00100000:3.0:1787756349.979575:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287136512 00000100:00100000:3.0:1787756349.979579:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287136512 00000100:00100000:3.0:1787756349.979593:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287136640 00000100:00100000:3.0:1787756349.979596:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287136640 00000100:00100000:3.0:1787756349.980699:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787756349.980710:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287136896:12345-0@lo:400: 00000100:00100000:3.0:1787756349.980797:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287136896:12345-0@lo:400: Request processed in 89us (4199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756349.980804:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787756349.980821:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787756349.980828:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287136512:12345-0@lo:400: 00010000:00080000:1.0:1787756349.981087:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c60780 x1874598287136896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756349.981102:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c60780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287136896:0@lo:400: 00000100:00100000:2.0:1787756349.981533:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787756349.981542:0:5843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787756349.981719:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787756349.981734:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287137152:0@lo:13: 00000100:00100000:0.0:1787756349.981782:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756349.981822:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287137152 00000100:00100000:0.0:1787756349.981828:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287137152 00000100:00100000:0.0:1787756349.981887:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787756349.981895:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af899112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287137152:12345-0@lo:13: 00002000:00000024:0.0:1787756349.981924:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787756349.982070:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787756349.982080:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287136640:12345-0@lo:400: 00000100:00100000:3.0:1787756349.982233:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c61680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287136512:12345-0@lo:400: Request processed in 1401us (4821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756349.982246:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787756349.982344:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787756349.982613:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af899112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287137152:12345-0@lo:13: Request processed in 717us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756349.982616:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c62580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287136640:12345-0@lo:400: Request processed in 537us (5120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756349.982626:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787756349.982630:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787756349.982691:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca0b40 x1874598287137152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756349.982721:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287137152:0@lo:13: 00010000:00080000:0.0:1787756349.982734:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99bed680 x1874598287136640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756349.982741:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287136640:0@lo:400: 00010000:00080000:0.0:1787756349.982757:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99bef840 x1874598287136512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787756365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756349.982767:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287136512:0@lo:400: 00000100:00100000:3.0:1787756349.988647:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756349.989046:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264045696 00000100:00100000:2.0:1787756349.989055:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264045696 00000100:00100000:2.0:1787756349.989094:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 111 00000100:00100000:2.0:1787756349.989102:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2362:x1874598264045696:12345-192.168.203.21@tcp:250: 00010000:00080000:2.0:1787756349.989129:0:5836:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from da773933-0c5c-4731-bbda-bf23609f1b54@192.168.203.21@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1787756349.989153:0:5836:0:(genops.c:1385:class_connect()) connect: client da773933-0c5c-4731-bbda-bf23609f1b54, cookie 0x178386880caab0bd 00000100:00080000:2.0:1787756349.990169:0:5836:0:(import.c:65:import_set_state_nolock()) ffff98afbfc70000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787756349.990245:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+5:2362:x1874598264045696:12345-192.168.203.21@tcp:250: Request processed in 1140us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756349.990255:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 111 00000100:00100000:2.0:1787756349.997068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756349.997139:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264045824 00000100:00100000:3.0:1787756349.997147:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264045824 00000100:00100000:3.0:1787756349.997198:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 112 00000100:00100000:3.0:1787756349.997208:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+5:5591:x1874598264045824:12345-192.168.203.21@tcp:101: 00010000:00010000:3.0:1787756349.997224:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756349.997241:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da6a00/0x178386880caab0c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa69b9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756349.997273:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da6a00/0x178386880caab0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69b9 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756349.997284:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da6a00/0x178386880caab0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69b9 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756349.997292:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da6a00, rc 0) 00000100:00100000:3.0:1787756349.997349:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+6:5591:x1874598264045824:12345-192.168.203.21@tcp:101: Request processed in 143us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756349.997356:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 112 00000100:00100000:3.0:1787756349.999228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756349.999368:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264045952 00000100:00100000:2.0:1787756349.999376:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264045952 00000100:00100000:2.0:1787756349.999421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00100000:2.0:1787756349.999430:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+6:5591:x1874598264045952:12345-192.168.203.21@tcp:501: 00000100:00100000:2.0:1787756349.999649:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+6:5591:x1874598264045952:12345-192.168.203.21@tcp:501: Request processed in 219us (428us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787756349.999656:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 113 00000100:00100000:0.0:1787756350.002593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756350.002651:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264046080 00000100:00100000:2.0:1787756350.002658:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264046080 00000100:00100000:2.0:1787756350.002713:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00100000:2.0:1787756350.002721:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+6:5591:x1874598264046080:12345-192.168.203.21@tcp:101: 00010000:00010000:2.0:1787756350.002736:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756350.002759:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98afc2045a00/0x178386880caab0cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa69c0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756350.002782:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afc2045a00/0x178386880caab0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69c0 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756350.002793:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98afc2045a00/0x178386880caab0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69c0 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756350.002801:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2045a00, rc 0) 00000100:00100000:2.0:1787756350.003168:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+7:5591:x1874598264046080:12345-192.168.203.21@tcp:101: Request processed in 445us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756350.003176:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 114 00000100:00100000:1.0:1787756350.006630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756350.006703:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264046208 00000100:00100000:3.0:1787756350.006713:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264046208 00000100:00100000:3.0:1787756350.006761:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:3.0:1787756350.006770:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+7:5591:x1874598264046208:12345-192.168.203.21@tcp:501: 00000100:00100000:3.0:1787756350.007378:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+8:5591:x1874598264046208:12345-192.168.203.21@tcp:501: Request processed in 606us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756350.007393:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 115 00000100:00100000:0.0:1787756350.009203:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756350.009232:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264046336 00000100:00100000:0.0:1787756350.009239:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264046336 00000100:00100000:0.0:1787756350.010122:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:0.0:1787756350.010133:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+8:5591:x1874598264046336:12345-192.168.203.21@tcp:503: 00000100:00100000:0.0:1787756350.010650:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+8:5591:x1874598264046336:12345-192.168.203.21@tcp:503: Request processed in 517us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756350.010660:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 116 00000100:00100000:0.0:1787756350.024459:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756350.024642:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264046464 00000100:00100000:3.0:1787756350.024651:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264046464 00000100:00100000:3.0:1787756350.024712:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 117 00000100:00100000:3.0:1787756350.024723:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+8:5609:x1874598264046464:12345-192.168.203.21@tcp:502: 00000100:00100000:3.0:1787756350.025504:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+8:5609:x1874598264046464:12345-192.168.203.21@tcp:502: Request processed in 778us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756350.025514:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 117 00000100:00100000:0.0:1787756350.053647:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756350.053692:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264046592 00000100:00100000:0.0:1787756350.053702:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264046592 00000100:00100000:0.0:1787756350.053747:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:0.0:1787756350.053757:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+8:5609:x1874598264046592:12345-192.168.203.21@tcp:502: 00000100:00100000:0.0:1787756350.054030:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+8:5609:x1874598264046592:12345-192.168.203.21@tcp:502: Request processed in 273us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756350.054047:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 118 00000100:00100000:2.0:1787756350.062565:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756350.064040:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264046720 00000100:00100000:3.0:1787756350.064053:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264046720 00000100:00100000:3.0:1787756350.064103:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:3.0:1787756350.064113:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+8:5591:x1874598264046720:12345-192.168.203.21@tcp:101: 00010000:00010000:3.0:1787756350.064129:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756350.064146:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da7c00/0x178386880caab0d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa69ea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756350.064175:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da7c00/0x178386880caab0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69ea expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756350.064185:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da7c00/0x178386880caab0d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69ea expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756350.064193:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7c00, rc 0) 00000100:00100000:3.0:1787756350.064256:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+9:5591:x1874598264046720:12345-192.168.203.21@tcp:101: Request processed in 144us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756350.064275:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 119 00000100:00100000:0.0:1787756350.075235:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756350.075275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264046848 00000100:00100000:0.0:1787756350.075285:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264046848 00000100:00100000:0.0:1787756350.075339:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:0.0:1787756350.075349:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+9:5591:x1874598264046848:12345-192.168.203.21@tcp:256: 20000000:01000000:0.0:1787756350.075577:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787756350.075598:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787756350.075602:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787756350.075605:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787756350.075608:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787756350.078274:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+9:5591:x1874598264046848:12345-192.168.203.21@tcp:256: Request processed in 2799us (2921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756350.078290:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 120 00000100:00100000:2.0:1787756350.083671:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756350.083763:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264046976 00000100:00100000:3.0:1787756350.083788:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264046976 00000100:00100000:0.0:1787756350.083969:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 121 00000100:00100000:0.0:1787756350.083981:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+9:5591:x1874598264046976:12345-192.168.203.21@tcp:101: 00010000:00010000:0.0:1787756350.083996:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756350.084017:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af80031400/0x178386880caab0d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa69f1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756350.084057:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af80031400/0x178386880caab0d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69f1 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756350.084069:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af80031400/0x178386880caab0d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69f1 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756350.084077:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af80031400, rc 0) 00000100:00100000:0.0:1787756350.084485:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:5591:x1874598264046976:12345-192.168.203.21@tcp:101: Request processed in 505us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756350.084493:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 121 00000100:00100000:0.0:1787756350.087359:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756350.087827:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264047104 00000100:00100000:2.0:1787756350.087860:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264047104 00000100:00100000:2.0:1787756350.087923:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 122 00000100:00100000:2.0:1787756350.087933:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:5591:x1874598264047104:12345-192.168.203.21@tcp:501: 00000100:00100000:2.0:1787756350.088614:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:5591:x1874598264047104:12345-192.168.203.21@tcp:501: Request processed in 679us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756350.088623:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 122 00000100:00100000:0.0:1787756350.090634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756350.090712:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264047232 00000100:00100000:1.0:1787756350.090720:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264047232 00000100:00100000:1.0:1787756350.090763:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:1.0:1787756350.090776:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:5591:x1874598264047232:12345-192.168.203.21@tcp:503: 00000100:00100000:1.0:1787756350.091307:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:5591:x1874598264047232:12345-192.168.203.21@tcp:503: Request processed in 534us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756350.091321:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 123 00000100:00100000:1.0:1787756350.094213:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756350.095362:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264047360 00000100:00100000:0.0:1787756350.095373:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264047360 00000100:00100000:0.0:1787756350.095469:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00100000:0.0:1787756350.095479:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:5613:x1874598264047360:12345-192.168.203.21@tcp:502: 00000100:00100000:0.0:1787756350.095757:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:5613:x1874598264047360:12345-192.168.203.21@tcp:502: Request processed in 279us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756350.095766:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 124 00000100:00100000:1.0:1787756350.097972:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756350.099216:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264047488 00000100:00100000:3.0:1787756350.099227:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264047488 00000100:00100000:3.0:1787756350.099336:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 125 00000100:00100000:3.0:1787756350.099347:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:5613:x1874598264047488:12345-192.168.203.21@tcp:502: 00000100:00100000:3.0:1787756350.099592:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:5613:x1874598264047488:12345-192.168.203.21@tcp:502: Request processed in 247us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756350.099601:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 125 00000100:00100000:2.0:1787756350.103436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756350.103506:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264047616 00000100:00100000:3.0:1787756350.103516:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264047616 00000100:00100000:3.0:1787756350.103572:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:3.0:1787756350.103580:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2362:x1874598264047616:12345-192.168.203.21@tcp:38: 00010000:00080000:3.0:1787756350.103609:0:5844:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1787756350.103649:0:5844:0:(genops.c:1385:class_connect()) connect: client bcdd3d25-193d-42cb-911a-069eb2969705, cookie 0x178386880caab0e0 00000004:00100000:3.0:1787756350.103685:0:5844:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787756350.103691:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787756350.137742:0:5844:0:(import.c:65:import_set_state_nolock()) ffff98ae820a1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787756350.137825:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+6:2362:x1874598264047616:12345-192.168.203.21@tcp:38: Request processed in 34242us (34400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756350.137873:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:1.0:1787756350.490871:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287137280:0@lo:13: 00000100:00100000:1.0:1787756350.490955:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756350.491078:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287137280 00000100:00100000:0.0:1787756350.491085:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287137280 00000100:00100000:0.0:1787756350.491132:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787756350.491142:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287137280:12345-0@lo:13: 00002000:00000024:0.0:1787756350.491176:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756350.491238:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c60780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287137280:12345-0@lo:13: Request processed in 98us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756350.491245:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787756350.491349:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba5a40 x1874598287137280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756350.491368:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287137280:0@lo:13: 00010000:00010000:1.0:1787756350.616031:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756351.147785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756351.147866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756351.148271:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264047744 00000100:00100000:3.0:1787756351.148281:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264047744 00000100:00100000:0.0:1787756351.148295:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264047872 00000100:00100000:0.0:1787756351.148302:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264047872 00000100:00100000:0.0:1787756351.148363:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:0.0:1787756351.148374:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+7:5591:x1874598264047872:12345-192.168.203.21@tcp:41: 00000100:00100000:3.0:1787756351.148397:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:3.0:1787756351.148406:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+7:0:x1874598264047744:12345-192.168.203.21@tcp:41: 00000004:00000024:0.0:1787756351.148417:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:3.0:1787756351.148441:0:8218:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787756351.148559:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+7:5591:x1874598264047872:12345-192.168.203.21@tcp:41: Request processed in 186us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756351.148567:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:3.0:1787756351.148863:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:0:x1874598264047744:12345-192.168.203.21@tcp:41: Request processed in 456us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756351.148871:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00080000:2.0:1787756351.149399:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787756351.161612:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756351.162006:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264048000 00000100:00100000:1.0:1787756351.162016:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264048000 00000100:00100000:1.0:1787756351.162106:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:1.0:1787756351.162117:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89910b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:5591:x1874598264048000:12345-192.168.203.21@tcp:40: 00000100:00100000:1.0:1787756351.162215:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89910b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:5591:x1874598264048000:12345-192.168.203.21@tcp:40: Request processed in 100us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756351.162222:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:1.0:1787756351.164472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756351.164610:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264048128 00000100:00100000:3.0:1787756351.164617:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264048128 00000100:00100000:3.0:1787756351.164663:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1787756351.164681:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1874598264048128:12345-192.168.203.21@tcp:8: 00010000:00080000:3.0:1787756351.164710:0:6692:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1787756351.164741:0:6692:0:(genops.c:1385:class_connect()) connect: client bcdd3d25-193d-42cb-911a-069eb2969705, cookie 0x178386880caab0e7 00002000:00100000:3.0:1787756351.164753:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bcdd3d25-193d-42cb-911a-069eb2969705/ffff98ae820a6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787756351.164775:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787756351.166310:0:6692:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787756351.166370:0:6692:0:(import.c:65:import_set_state_nolock()) ffff98ae820a7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787756351.166665:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcdd3d25-193d-42cb-911a-069eb2969705+6:2362:x1874598264048128:12345-192.168.203.21@tcp:8: Request processed in 1980us (2195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756351.166684:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:0.0:1787756351.166706:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756351.166746:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264048384 00000100:00100000:3.0:1787756351.166752:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264048384 00000100:00100000:3.0:1787756351.166990:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 126 00000100:00100000:3.0:1787756351.167001:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2364:x1874598264048384:12345-192.168.203.21@tcp:400: 00000100:00100000:3.0:1787756351.167040:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2364:x1874598264048384:12345-192.168.203.21@tcp:400: Request processed in 41us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756351.167047:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 126 00000100:00100000:2.0:1787756351.167121:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756351.167177:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756351.167289:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264048256 00000100:00100000:1.0:1787756351.167294:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264048256 00000100:00100000:1.0:1787756351.167326:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:1.0:1787756351.167332:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874598264048256:12345-192.168.203.21@tcp:8: 00010000:00080000:1.0:1787756351.167681:0:6693:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1787756351.167705:0:6693:0:(genops.c:1385:class_connect()) connect: client bcdd3d25-193d-42cb-911a-069eb2969705, cookie 0x178386880caab0ee 00002000:00100000:1.0:1787756351.167715:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bcdd3d25-193d-42cb-911a-069eb2969705/ffff98af8a302000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787756351.167726:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787756351.168016:0:6693:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787756351.168036:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98af8a302800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787756351.168073:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcdd3d25-193d-42cb-911a-069eb2969705+6:2362:x1874598264048256:12345-192.168.203.21@tcp:8: Request processed in 740us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756351.168088:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:0.0:1787756351.169289:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264048512 00000100:00100000:0.0:1787756351.169297:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264048512 00000100:00100000:0.0:1787756351.169342:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1787756351.169351:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:5591:x1874598264048512:12345-192.168.203.21@tcp:33: 00000004:00080000:0.0:1787756351.182823:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13415us 00000004:00200000:0.0:1787756351.196412:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787756351.196595:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:5591:x1874598264048512:12345-192.168.203.21@tcp:33: Request processed in 27239us (29411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756351.196606:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:2.0:1787756351.343479:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756351.344403:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264048640 00000100:00100000:0.0:1787756351.344414:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264048640 00000100:00100000:0.0:1787756351.344490:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:0.0:1787756351.344500:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+6:5630:x1874598264048640:12345-192.168.203.21@tcp:101: 00010000:00010000:0.0:1787756351.344519:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756351.344603:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af80031e00/0x178386880caab0f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a1b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756351.344676:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af80030400/0x178386880caab0fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756351.344690:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af80030400/0x178386880caab0fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756351.344703:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af80030400/0x178386880caab0fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787756351.345069:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787756351.345074:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787756351.345163:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98af80030400/0x178386880caab0fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756351.345312:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af80031e00/0x178386880caab0f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a1b expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756351.345331:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98af80030400/0x178386880caab0fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a1b expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756351.345340:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08600) 00010000:00010000:0.0:1787756351.345343:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787756351.345346:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af80030400, rc 0) 00000100:00100000:0.0:1787756351.345421:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+7:5630:x1874598264048640:12345-192.168.203.21@tcp:101: Request processed in 922us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756351.345429:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00010000:00010000:2.0:1787756351.640040:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756352.665008:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756353.250389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756353.252067:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264048768 00000100:00100000:0.0:1787756353.252079:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264048768 00000100:00100000:0.0:1787756353.252222:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:0.0:1787756353.252232:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+7:5682:x1874598264048768:12345-192.168.203.21@tcp:41: 00000004:00000024:0.0:1787756353.252275:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787756353.252361:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+7:5682:x1874598264048768:12345-192.168.203.21@tcp:41: Request processed in 129us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756353.252369:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00080000:2.0:1787756353.252820:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787756353.259806:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756353.260561:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264048896 00000100:00100000:0.0:1787756353.260571:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264048896 00000100:00100000:0.0:1787756353.260692:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:0.0:1787756353.260703:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bcdd3d25-193d-42cb-911a-069eb2969705+6:5682:x1874598264048896:12345-192.168.203.21@tcp:13: 00002000:00000024:0.0:1787756353.261190:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756353.261265:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bcdd3d25-193d-42cb-911a-069eb2969705+6:5682:x1874598264048896:12345-192.168.203.21@tcp:13: Request processed in 563us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756353.261286:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00080000:2.0:1787756353.263190:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787756353.263230:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756353.263389:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264049024 00000100:00100000:1.0:1787756353.263397:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264049024 00000100:00100000:1.0:1787756353.263461:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:1.0:1787756353.263471:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bcdd3d25-193d-42cb-911a-069eb2969705+6:5682:x1874598264049024:12345-192.168.203.21@tcp:13: 00000100:00080000:2.0:1787756353.263474:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787756353.263504:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787756353.263561:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bcdd3d25-193d-42cb-911a-069eb2969705+6:5682:x1874598264049024:12345-192.168.203.21@tcp:13: Request processed in 91us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756353.263568:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00010000:00010000:2.0:1787756353.687989:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787756354.697929:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bcdd3d25-193d-42cb-911a-069eb2969705 00010000:00010000:1.0:1787756354.712905:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756355.096461:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89913840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287137536:0@lo:400: 00000100:00100000:0.0:1787756355.096530:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756355.096590:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287138048:0@lo:400: 00000100:00100000:0.0:1787756355.096636:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756355.096682:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787756355.096688:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89911a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287137664:0@lo:400: 00000100:00100000:0.0:1787756355.096712:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756355.096742:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287137536 00000100:00100000:0.0:1787756355.096749:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287137536 00000100:00100000:0.0:1787756355.096791:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287137664 00000100:00100000:0.0:1787756355.096795:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287137664 00000100:00100000:0.0:1787756355.096879:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787756355.096888:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287137536:12345-0@lo:400: 00000100:00100000:0.0:1787756355.096939:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287137536:12345-0@lo:400: Request processed in 52us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756355.096947:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787756355.096965:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787756355.096971:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287137664:12345-0@lo:400: 00000100:00100000:0.0:1787756355.096997:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287137664:12345-0@lo:400: Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756355.097003:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787756355.097059:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89911a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287137664:0@lo:400: 00000100:00100000:0.0:1787756355.097070:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89913840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287137536:0@lo:400: 00000100:00100000:0.0:1787756355.097107:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287138048 00000100:00100000:0.0:1787756355.097119:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287138048 00000100:00100000:0.0:1787756355.097145:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787756355.097152:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287138048:12345-0@lo:400: 00000100:00100000:0.0:1787756355.097187:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287138048:12345-0@lo:400: Request processed in 36us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756355.097193:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787756355.097222:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99bf52c0 x1874598287138048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756355.097233:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287138048:0@lo:400: 00000100:00100000:1.0:1787756355.097316:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287137792:0@lo:400: 00000100:00100000:1.0:1787756355.097346:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756355.097374:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787756355.097380:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af89910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287137408:0@lo:400: 00000100:00100000:1.0:1787756355.097407:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756355.097430:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287137920:0@lo:400: 00000100:00100000:1.0:1787756355.097452:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756355.097477:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287137920 00000100:00100000:1.0:1787756355.097480:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287137920 00000100:00100000:1.0:1787756355.097508:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787756355.097515:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287137920:12345-0@lo:400: 00000100:00100000:1.0:1787756355.097548:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c63c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287137920:12345-0@lo:400: Request processed in 34us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756355.097555:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787756355.097574:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287137792 00000100:00100000:1.0:1787756355.097583:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287137792 00000100:00100000:1.0:1787756355.097611:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787756355.097618:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287137792:12345-0@lo:400: 00000100:00100000:1.0:1787756355.097661:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287137792:12345-0@lo:400: Request processed in 44us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756355.097667:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787756355.097697:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287137920:0@lo:400: 00010000:00080000:1.0:1787756355.097708:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af899130c0 x1874598287137792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756355.097718:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af899130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287137792:0@lo:400: 00000100:00080000:2.0:1787756355.098075:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787756355.098080:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787756355.098083:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787756355.098157:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787756355.098166:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287138176:0@lo:13: 00000100:00100000:1.0:1787756355.098194:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756355.098259:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287138176 00000100:00100000:2.0:1787756355.098263:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287138176 00000100:00100000:2.0:1787756355.098298:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787756355.098305:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287138176:12345-0@lo:13: 00002000:00000024:2.0:1787756355.098321:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787756355.098356:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287138176:12345-0@lo:13: Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756355.098362:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787756355.098387:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca0f00 x1874598287138176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756355.098402:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287138176:0@lo:13: 00000100:00100000:2.0:1787756355.099029:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287137408 00000100:00100000:2.0:1787756355.099035:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287137408 00000100:00100000:2.0:1787756355.099072:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787756355.099079:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3311:x1874598287137408:12345-0@lo:400: 00000100:00100000:2.0:1787756355.099124:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3311:x1874598287137408:12345-0@lo:400: Request processed in 45us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756355.099139:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787756355.099312:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af89910f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287137408:0@lo:400: 00000001:02000400:2.0:1787756355.541573:0:8306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787756355.609437:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287138304:0@lo:13: 00000100:00100000:3.0:1787756355.609527:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756355.609597:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287138304 00000100:00100000:3.0:1787756355.609603:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287138304 00000100:00100000:3.0:1787756355.609654:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787756355.609664:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287138304:12345-0@lo:13: 00002000:00000024:3.0:1787756355.609694:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787756355.609732:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287138304:12345-0@lo:13: Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756355.609740:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787756355.609774:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba61c0 x1874598287138304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756355.609790:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287138304:0@lo:13: 00000001:00100000:0.0:1787756355.660382:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bcdd3d25-193d-42cb-911a-069eb2969705 00000001:00100000:3.0:1787756355.665023:0:7654:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bcdd3d25-193d-42cb-911a-069eb2969705 00010000:00010000:2.0:1787756355.735981:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756356.523999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756356.524037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756356.524067:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756356.524086:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756356.524111:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264049536 00000100:00100000:3.0:1787756356.524118:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264049536 00000100:00100000:3.0:1787756356.524177:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264049408 00000100:00100000:3.0:1787756356.524180:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264049408 00000100:00100000:3.0:1787756356.524198:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1787756356.524207:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcdd3d25-193d-42cb-911a-069eb2969705+5:2366:x1874598264049536:12345-192.168.203.21@tcp:400: 00000100:00100000:3.0:1787756356.524267:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcdd3d25-193d-42cb-911a-069eb2969705+5:2366:x1874598264049536:12345-192.168.203.21@tcp:400: Request processed in 61us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756356.524286:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1787756356.524303:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1787756356.524310:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcdd3d25-193d-42cb-911a-069eb2969705+5:2366:x1874598264049408:12345-192.168.203.21@tcp:400: 00000100:00100000:3.0:1787756356.524334:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcdd3d25-193d-42cb-911a-069eb2969705+5:2366:x1874598264049408:12345-192.168.203.21@tcp:400: Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756356.524340:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1787756356.524357:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264049152 00000100:00100000:3.0:1787756356.524360:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264049152 00000100:00100000:3.0:1787756356.524383:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 128 00000100:00100000:3.0:1787756356.524389:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2366:x1874598264049152:12345-192.168.203.21@tcp:400: 00000100:00100000:3.0:1787756356.524412:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2366:x1874598264049152:12345-192.168.203.21@tcp:400: Request processed in 24us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756356.524419:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 128 00000100:00080000:3.0:1787756356.524446:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787756356.524450:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787756356.524857:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264049280 00000100:00100000:0.0:1787756356.524862:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264049280 00000100:00100000:0.0:1787756356.524898:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:0.0:1787756356.524904:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2366:x1874598264049280:12345-192.168.203.21@tcp:400: 00000100:00100000:0.0:1787756356.524931:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2366:x1874598264049280:12345-192.168.203.21@tcp:400: Request processed in 27us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756356.524937:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00080000:3.0:1787756356.525301:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787756356.760787:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756357.784273:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787756358.647816:0:8458:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef47a6020 20000000:00000080:1.0:1787756358.647892:0:8458:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98afbb42f000 uarg=0000000000000000 20000000:01000000:1.0:1787756358.647928:0:8458:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787756358.647930:0:8458:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787756358.647933:0:8458:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787756358.647938:0:8458:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787756358.647942:0:8458:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787756358.647956:0:8458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787756358.647958:0:8458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787756358.648124:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787756358.648126:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787756358.648822:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787756358.649320:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787756358.649377:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787756358.649409:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787756358.649420:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787756358.649421:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787756358.650225:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787756358.650550:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787756358.650595:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787756358.650720:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787756358.650734:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787756358.650736:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787756358.651520:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787756358.652121:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787756358.652176:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787756358.652213:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1787756358.652225:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787756358.652228:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787756358.652947:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787756358.653273:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787756358.653312:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787756358.653341:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1787756358.653356:0:8458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787756358.653380:0:8458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653398:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af84da6c00/0x178386880caab000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaff9 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653406:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af84da7400/0x178386880caab02a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab023 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653413:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af80030a00/0x178386880caab054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab04d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653421:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98afb3845000/0x178386880caab062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab05b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653427:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af80031a00/0x178386880caab070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab069 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653435:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98afc2045e00/0x178386880caab08c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab085 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653442:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98afb3845800/0x178386880caab0b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab0af expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653451:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af84da6a00/0x178386880caab0c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69b9 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653458:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98afc2045a00/0x178386880caab0cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69c0 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653465:0:8458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653512:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98afc2045a00/0x178386880caab0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69c0 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653526:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98afc2045a00/0x178386880caab0cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69c0 expref: 9 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.653540:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c730c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287138432:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787756358.653761:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af84da6a00/0x178386880caab0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69b9 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653771:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98af84da6a00/0x178386880caab0c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69b9 expref: 9 pid: 5837 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.653781:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c73840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287138560:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787756358.653813:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98afb3845800/0x178386880caab0b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caab0af expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653821:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98afb3845800/0x178386880caab0b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caab0af expref: 18 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.653861:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c70b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287138688:0@lo:104: 00000100:00100000:0.0:1787756358.653900:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787756358.653939:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98afc2045e00/0x178386880caab08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caab085 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.653948:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98afc2045e00/0x178386880caab08c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caab085 expref: 18 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.653967:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c71a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287138816:0@lo:104: 00000100:00100000:0.0:1787756358.653991:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787756358.654017:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af80031a00/0x178386880caab070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caab069 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.654026:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af80031a00/0x178386880caab070 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caab069 expref: 18 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.654034:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c72580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287138944:0@lo:104: 00010000:00010000:0.0:1787756358.654053:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98afb3845000/0x178386880caab062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caab05b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.654060:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98afb3845000/0x178386880caab062 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caab05b expref: 18 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.654068:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c703c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287139072:0@lo:104: 00010000:00010000:0.0:1787756358.654087:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af80030a00/0x178386880caab054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caab04d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.654095:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af80030a00/0x178386880caab054 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caab04d expref: 18 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.654102:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287139200:0@lo:104: 00010000:00010000:0.0:1787756358.654120:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af84da7400/0x178386880caab02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caab023 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.654127:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af84da7400/0x178386880caab02a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caab023 expref: 18 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.654147:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c73c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287139328:0@lo:104: 00010000:00010000:0.0:1787756358.654175:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af84da6c00/0x178386880caab000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaaff9 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.654183:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af84da6c00/0x178386880caab000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaaff9 expref: 18 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.654190:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287139456:0@lo:104: 00000100:00100000:0.0:1787756358.654206:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9191c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787756358.654279:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787756358.654296:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756358.654308:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756358.654314:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756358.654323:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756358.654330:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756358.654336:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287138688 00000100:00100000:3.0:1787756358.654346:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287138688 00000100:00100000:3.0:1787756358.654376:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287138816 00000100:00100000:3.0:1787756358.654378:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287138816 00000100:00100000:3.0:1787756358.654386:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287138944 00000100:00100000:3.0:1787756358.654388:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287138944 00000100:00100000:3.0:1787756358.654395:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287139072 00000100:00100000:3.0:1787756358.654397:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287139072 00000100:00100000:3.0:1787756358.654404:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287139200 00000100:00100000:3.0:1787756358.654405:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287139200 00000100:00100000:3.0:1787756358.654412:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287139328 00000100:00100000:3.0:1787756358.654414:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287139328 00000100:00100000:3.0:1787756358.654421:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287139456 00000100:00100000:3.0:1787756358.654423:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287139456 00000100:00100000:3.0:1787756358.654434:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787756358.654441:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c71680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:8458:x1874598287138688:12345-0@lo:104: 00010000:00010000:3.0:1787756358.654452:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.654506:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787756358.654511:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c71680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+9:8458:x1874598287138688:12345-0@lo:104: Request processed in 71us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756358.654518:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787756358.654536:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787756358.654543:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3841050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+8:8458:x1874598287138816:12345-0@lo:104: 00010000:00010000:3.0:1787756358.654551:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.654582:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787756358.654587:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3841050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+8:8458:x1874598287138816:12345-0@lo:104: Request processed in 45us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756358.654592:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787756358.654643:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787756358.654650:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+7:8458:x1874598287138944:12345-0@lo:104: 00000100:00100000:0.0:1787756358.654748:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c70b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287138688:0@lo:104: 00000100:00100000:0.0:1787756358.654756:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c71a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287138816:0@lo:104: 00010000:00010000:3.0:1787756358.654793:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.654855:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787756358.654860:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+7:8458:x1874598287138944:12345-0@lo:104: Request processed in 211us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756358.654866:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787756358.654879:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787756358.654884:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+6:8458:x1874598287139072:12345-0@lo:104: 00010000:00010000:3.0:1787756358.654891:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.654918:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787756358.654922:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+6:8458:x1874598287139072:12345-0@lo:104: Request processed in 39us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756358.654928:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787756358.654938:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787756358.654945:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+5:8458:x1874598287139200:12345-0@lo:104: 00010000:00010000:3.0:1787756358.654951:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.654975:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787756358.654980:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+5:8458:x1874598287139200:12345-0@lo:104: Request processed in 36us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756358.654987:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787756358.655003:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787756358.655009:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:8458:x1874598287139328:12345-0@lo:104: 00010000:00010000:3.0:1787756358.655016:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.655037:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787756358.655042:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:8458:x1874598287139328:12345-0@lo:104: Request processed in 34us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756358.655048:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787756358.655056:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787756358.655061:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:8458:x1874598287139456:12345-0@lo:104: 00010000:00010000:3.0:1787756358.655068:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.655087:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787756358.655091:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:8458:x1874598287139456:12345-0@lo:104: Request processed in 31us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756358.655096:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787756358.655265:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c72580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287138944:0@lo:104: 00000100:00100000:0.0:1787756358.655273:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c703c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287139072:0@lo:104: 00000100:00100000:0.0:1787756358.655279:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287139200:0@lo:104: 00000100:00100000:0.0:1787756358.655285:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c73c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287139328:0@lo:104: 00000100:00100000:0.0:1787756358.655292:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287139456:0@lo:104: 00010000:00010000:2.0:1787756358.655471:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787756358.655478:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.655485:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afb3844200 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756358.655490:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.655499:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756358.655506:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756358.655512:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787756358.655583:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.655590:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787756358.655625:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.655632:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afb3844200/0x178386880caab0af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab0b6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.655720:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787756358.655725:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.655732:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af80030c00 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756358.655735:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.655742:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756358.655749:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756358.655755:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787756358.655863:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287139584:0@lo:103: 00000100:00100000:3.0:1787756358.655899:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756358.655947:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287139584 00000100:00100000:3.0:1787756358.655952:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287139584 00010000:00010000:3.0:1787756358.655974:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98afb3845800/0x178386880caab0b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab0af expref: 19 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756358.656000:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787756358.656006:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287139584:12345-0@lo:103: 00010000:00010000:3.0:1787756358.656016:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787756358.656026:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98afb3845800/0x178386880caab0b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab0af expref: 19 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.656036:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98afb3845800/0x178386880caab0b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caab0af expref: 19 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.656050:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afb3845800/0x178386880caab0b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caab0af expref: 19 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.656061:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787756358.656086:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:3312:x1874598287139584:12345-0@lo:103: Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756358.656093:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787756358.656117:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287139584:0@lo:103: 00010000:00010000:2.0:1787756358.656331:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.656337:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787756358.656357:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.656364:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af80030c00/0x178386880caab085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab08c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.656374:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787756358.656377:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.656392:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af84da6000 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756358.656396:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.656404:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756358.656410:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756358.656415:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787756358.656484:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287139712:0@lo:103: 00000100:00100000:3.0:1787756358.656510:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756358.656578:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287139712 00000100:00100000:0.0:1787756358.656582:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287139712 00010000:00010000:0.0:1787756358.656601:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98afc2045e00/0x178386880caab08c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab085 expref: 18 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.656633:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787756358.656639:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:3309:x1874598287139712:12345-0@lo:103: 00010000:00010000:0.0:1787756358.656648:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756358.656661:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98afc2045e00/0x178386880caab08c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab085 expref: 18 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.656676:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98afc2045e00/0x178386880caab08c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caab085 expref: 18 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.656687:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afc2045e00/0x178386880caab08c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caab085 expref: 18 pid: 5836 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.656696:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756358.656722:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:3309:x1874598287139712:12345-0@lo:103: Request processed in 84us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756358.656728:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787756358.656859:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287139712:0@lo:103: 00010000:00010000:2.0:1787756358.657133:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.657140:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787756358.657169:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787756358.657209:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.657217:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af84da6000/0x178386880caab069 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab070 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.657227:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787756358.657230:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.657236:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af84da7200 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756358.657240:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.657257:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756358.657264:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756358.657270:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787756358.657292:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.657298:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787756358.657329:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287139968:0@lo:103: 00000100:00100000:0.0:1787756358.657356:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756358.657401:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287139968 00000100:00100000:1.0:1787756358.657405:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287139968 00010000:00010000:1.0:1787756358.657421:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98afb3845000/0x178386880caab062 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab05b expref: 17 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756358.657440:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787756358.657446:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:3311:x1874598287139968:12345-0@lo:103: 00010000:00010000:1.0:1787756358.657453:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787756358.657456:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98afb3845000/0x178386880caab062 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab05b expref: 17 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756358.657465:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98afb3845000/0x178386880caab062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caab05b expref: 17 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756358.657476:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afb3845000/0x178386880caab062 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caab05b expref: 17 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756358.657484:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787756358.657520:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.657527:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af84da7200/0x178386880caab05b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab062 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.657536:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787756358.657539:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.657545:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af80030e00 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756358.657548:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.657555:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756358.657561:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756358.657573:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787756358.657588:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.657593:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787756358.657630:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287139840:0@lo:103: 00000100:00100000:3.0:1787756358.657662:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756358.657684:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287140096:0@lo:103: 00000100:00100000:3.0:1787756358.657703:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756358.657719:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787756358.657725:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787756358.657871:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:3311:x1874598287139968:12345-0@lo:103: Request processed in 424us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756358.657878:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787756358.657893:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287139840 00000100:00100000:1.0:1787756358.657896:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287139840 00010000:00010000:1.0:1787756358.657909:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af80031a00/0x178386880caab070 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab069 expref: 16 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756358.657921:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287140096 00000100:00100000:1.0:1787756358.657928:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287140096 00010000:00010000:1.0:1787756358.657940:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af80030a00/0x178386880caab054 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab04d expref: 17 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756358.657954:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787756358.657959:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:3309:x1874598287139840:12345-0@lo:103: 00010000:00010000:1.0:1787756358.657965:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787756358.657970:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af80031a00/0x178386880caab070 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab069 expref: 17 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756358.657977:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af80031a00/0x178386880caab070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caab069 expref: 17 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756358.657987:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af80031a00/0x178386880caab070 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caab069 expref: 17 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756358.657996:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787756358.658023:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:3309:x1874598287139840:12345-0@lo:103: Request processed in 64us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756358.658028:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787756358.658039:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787756358.658044:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:3312:x1874598287140096:12345-0@lo:103: 00010000:00010000:1.0:1787756358.658051:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787756358.658054:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af80030a00/0x178386880caab054 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab04d expref: 15 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756358.658063:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af80030a00/0x178386880caab054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caab04d expref: 15 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756358.658072:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af80030a00/0x178386880caab054 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caab04d expref: 15 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756358.658085:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787756358.658110:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:3312:x1874598287140096:12345-0@lo:103: Request processed in 65us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756358.658115:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787756358.658140:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287140096:0@lo:103: 00000100:00100000:3.0:1787756358.658213:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287139840:0@lo:103: 00000100:00100000:0.0:1787756358.658268:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287139968:0@lo:103: 00010000:00010000:2.0:1787756358.658343:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.658352:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af80030e00/0x178386880caab04d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab054 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.658362:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787756358.658365:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.658371:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2044600 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756358.658374:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.658381:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756358.658388:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756358.658394:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787756358.658441:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.658448:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787756358.658467:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.658474:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc2044600/0x178386880caab023 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab02a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.658483:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787756358.658487:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.658493:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc21cfc00 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756358.658496:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.658502:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756358.658508:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756358.658513:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787756358.658542:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287140224:0@lo:103: 00000100:00100000:3.0:1787756358.658568:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756358.658645:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287140224 00000100:00100000:0.0:1787756358.658649:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287140224 00010000:00010000:0.0:1787756358.658672:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af84da7400/0x178386880caab02a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab023 expref: 14 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.658697:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787756358.658703:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af88d93840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:3309:x1874598287140224:12345-0@lo:103: 00010000:00010000:0.0:1787756358.658710:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756358.658714:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af84da7400/0x178386880caab02a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab023 expref: 14 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.658722:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af84da7400/0x178386880caab02a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caab023 expref: 14 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.658732:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da7400/0x178386880caab02a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caab023 expref: 14 pid: 5835 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.658746:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756358.658770:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af88d93840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:3309:x1874598287140224:12345-0@lo:103: Request processed in 68us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756358.658777:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787756358.659007:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287140224:0@lo:103: 00010000:00010000:2.0:1787756358.659149:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.659156:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787756358.659185:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787756358.659200:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.659207:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc21cfc00/0x178386880caaaff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab000 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.659222:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756358.659229:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756358.659231:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756358.659239:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756358.659525:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287140352:0@lo:103: 00000100:00100000:3.0:1787756358.659558:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756358.659712:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287140352 00000100:00100000:0.0:1787756358.659717:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287140352 00010000:00010000:0.0:1787756358.659735:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af84da6c00/0x178386880caab000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaff9 expref: 13 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.659785:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787756358.659792:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85b1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:3309:x1874598287140352:12345-0@lo:103: 00010000:00010000:0.0:1787756358.659800:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756358.659804:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af84da6c00/0x178386880caab000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaff9 expref: 13 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.659814:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af84da6c00/0x178386880caab000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaaff9 expref: 13 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.659827:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da6c00/0x178386880caab000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaaff9 expref: 13 pid: 5837 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.659860:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756358.659893:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85b1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:3309:x1874598287140352:12345-0@lo:103: Request processed in 102us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756358.659900:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787756358.659983:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287140352:0@lo:103: 00000100:00100000:0.0:1787756358.660749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756358.660780:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756358.661103:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c730c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287138432:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787756358.661113:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c73840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874598287138560:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787756358.661148:0:8458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756358.661218:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264049664 00000100:00100000:1.0:1787756358.661223:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264049664 00000100:00100000:2.0:1787756358.661297:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264049792 00000100:00100000:2.0:1787756358.661302:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264049792 00010000:00010000:2.0:1787756358.661326:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af84da6a00/0x178386880caab0c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69b9 expref: 11 pid: 5837 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756358.661357:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:2.0:1787756358.661365:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c71e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da773933-0c5c-4731-bbda-bf23609f1b54+11:2365:x1874598264049792:12345-192.168.203.21@tcp:103: 00010000:00010000:2.0:1787756358.661377:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787756358.661381:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af84da6a00/0x178386880caab0c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69b9 expref: 11 pid: 5837 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.661391:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af84da6a00/0x178386880caab0c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69b9 expref: 11 pid: 5837 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.661406:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da6a00/0x178386880caab0c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69b9 expref: 11 pid: 5837 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.661418:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787756358.661469:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c71e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2365:x1874598264049792:12345-192.168.203.21@tcp:103: Request processed in 104us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756358.661476:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00010000:00010000:0.0:1787756358.662043:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98afc2045a00/0x178386880caab0cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69c0 expref: 9 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756358.662116:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:0.0:1787756358.662124:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da773933-0c5c-4731-bbda-bf23609f1b54+9:2365:x1874598264049664:12345-192.168.203.21@tcp:103: 00010000:00010000:0.0:1787756358.662133:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756358.662137:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98afc2045a00/0x178386880caab0cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69c0 expref: 9 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662146:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98afc2045a00/0x178386880caab0cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69c0 expref: 9 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662157:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afc2045a00/0x178386880caab0cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69c0 expref: 9 pid: 5836 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662169:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662176:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662191:0:8463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662198:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662206:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662212:0:8463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662230:0:8463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81543200 already unused, calling callback (ffffffffc162d530) 00010000:00010000:0.0:1787756358.662234:0:8463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662242:0:8463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662264:0:8463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756358.662275:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756358.662311:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:da773933-0c5c-4731-bbda-bf23609f1b54+8:2365:x1874598264049664:12345-192.168.203.21@tcp:103: Request processed in 187us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756358.662318:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00010000:00010000:3.0:1787756358.662455:0:8458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.662463:0:8458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756358.662470:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af81543200/0x178386880caab103 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756358.810304:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756359.832025:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787756360.023932:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787756360.023939:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98af85ba0800 from 39 10000000:01000000:1.0:1787756360.023945:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787756360.023990:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afb3845000/0x178386880caab10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.024001:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afb3845000/0x178386880caab10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.024012:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afb3845000/0x178386880caab10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756360.024036:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287140480:0@lo:101: 00000100:00100000:1.0:1787756360.024106:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.024173:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787756360.024254:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287140480 00000100:00100000:0.0:1787756360.024261:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287140480 00000100:00100000:0.0:1787756360.024313:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787756360.024321:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+12:5839:x1874598287140480:12345-0@lo:101: 00010000:00010000:0.0:1787756360.024332:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756360.024345:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af81543400/0x178386880caab111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab10a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.024364:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af81543400/0x178386880caab111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab10a expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.024374:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af81543400/0x178386880caab111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab10a expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.024383:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af81543400, rc 0) 00000100:00100000:0.0:1787756360.024441:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287140480:12345-0@lo:101: Request processed in 121us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.024449:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787756360.024523:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287140480:0@lo:101: 00010000:00010000:1.0:1787756360.024535:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afb3845000/0x178386880caab10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab111 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.024554:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afb3845000/0x178386880caab10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab111 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756360.024614:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287140608:0@lo:501: 00000100:00100000:1.0:1787756360.024639:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.024662:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787756360.024716:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287140608 00000100:00100000:2.0:1787756360.024720:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287140608 00000100:00100000:2.0:1787756360.024748:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787756360.024754:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287140608:12345-0@lo:501: 00000100:00100000:2.0:1787756360.025013:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287140608:12345-0@lo:501: Request processed in 258us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756360.025020:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787756360.025089:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287140608:0@lo:501: 00000100:00100000:1.0:1787756360.025117:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287140736:0@lo:503: 00000100:00100000:1.0:1787756360.025150:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.025177:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787756360.025226:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287140736 00000100:00100000:0.0:1787756360.025230:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287140736 00000100:00100000:0.0:1787756360.025249:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787756360.025254:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287140736:12345-0@lo:503: 00000100:00100000:0.0:1787756360.025387:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287140736:12345-0@lo:503: Request processed in 132us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.025395:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787756360.025461:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287140736:0@lo:503: 00000100:00100000:1.0:1787756360.025897:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8475:1874598287140864:0@lo:502: 00000100:00100000:1.0:1787756360.025935:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.025964:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787756360.026010:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287140864 00000100:00100000:0.0:1787756360.026014:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287140864 00000100:00100000:0.0:1787756360.026045:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787756360.026053:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:8475:x1874598287140864:12345-0@lo:502: 00000100:00100000:0.0:1787756360.026223:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:8475:x1874598287140864:12345-0@lo:502: Request processed in 170us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.026230:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787756360.026304:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8475:1874598287140864:0@lo:502: 00000100:00100000:1.0:1787756360.026342:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8475:1874598287140992:0@lo:502: 00000100:00100000:1.0:1787756360.026372:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.026393:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787756360.026416:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287140992 00000100:00100000:3.0:1787756360.026424:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287140992 00000100:00100000:3.0:1787756360.026452:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787756360.026459:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:8475:x1874598287140992:12345-0@lo:502: 00000100:00100000:3.0:1787756360.026591:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:8475:x1874598287140992:12345-0@lo:502: Request processed in 132us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756360.026644:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8475:1874598287140992:0@lo:502: 00000040:00080000:1.0:1787756360.026662:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787756360.026791:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787756360.026806:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787756360.026814:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afb3845000/0x178386880caab10a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab111 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.026823:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afb3845000/0x178386880caab10a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab111 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787756360.026853:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787756360.026855:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787756360.026858:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787756360.026883:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af81542400/0x178386880caab118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.026891:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af81542400/0x178386880caab118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.026899:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af81542400/0x178386880caab118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756360.026910:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287141120:0@lo:101: 00000100:00100000:0.0:1787756360.026936:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756360.026959:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9191c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787756360.027029:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287141120 00000100:00100000:1.0:1787756360.027034:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287141120 00000100:00100000:3.0:1787756360.038430:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787756360.038747:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787756360.038763:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+13:5839:x1874598287141120:12345-0@lo:101: 00010000:00010000:1.0:1787756360.038791:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787756360.038807:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98afb3845a00/0x178386880caab11f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab118 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.038849:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afb3845a00/0x178386880caab11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab118 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.038860:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98afb3845a00/0x178386880caab11f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab118 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.038868:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afb3845a00, rc 0) 00000100:00100000:1.0:1787756360.038935:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287141120:12345-0@lo:101: Request processed in 178us (11997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756360.038941:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787756360.038976:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287141120:0@lo:101: 00010000:00010000:0.0:1787756360.038994:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af81542400/0x178386880caab118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab11f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.039004:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af81542400/0x178386880caab118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab11f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756360.039089:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287141248:0@lo:501: 00000100:00100000:0.0:1787756360.039120:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756360.039155:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9191c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787756360.039932:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287141248 00000100:00100000:3.0:1787756360.039938:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287141248 00000100:00100000:3.0:1787756360.040079:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787756360.040088:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287141248:12345-0@lo:501: 00000100:00100000:3.0:1787756360.040332:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287141248:12345-0@lo:501: Request processed in 245us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756360.040339:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787756360.041368:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287141248:0@lo:501: 00000100:00100000:0.0:1787756360.043126:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287141376:0@lo:503: 00000100:00100000:0.0:1787756360.043274:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756360.043319:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9191c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787756360.043345:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287141376 00000100:00100000:0.0:1787756360.043351:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287141376 00000100:00100000:0.0:1787756360.043405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787756360.043414:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287141376:12345-0@lo:503: 00000100:00100000:0.0:1787756360.043590:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287141376:12345-0@lo:503: Request processed in 176us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.043598:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787756360.043657:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287141376:0@lo:503: 00000100:00100000:0.0:1787756360.043820:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8476:1874598287141504:0@lo:502: 00000100:00100000:0.0:1787756360.043869:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756360.043889:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287141504 00000100:00100000:0.0:1787756360.043892:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287141504 00000100:00100000:0.0:1787756360.043908:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787756360.043915:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:8476:x1874598287141504:12345-0@lo:502: 00000100:00100000:1.0:1787756360.043995:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9191c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756360.045255:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:8476:x1874598287141504:12345-0@lo:502: Request processed in 1334us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.045265:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787756360.045423:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8476:1874598287141504:0@lo:502: 00000020:01000000:1.0:1787756360.045450:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787756360.045459:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756360.045462:0:8476:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787756360.045467:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787756360.045496:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8476:1874598287141632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756360.045537:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.045561:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787756360.045767:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287141632 00000100:00100000:0.0:1787756360.045773:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287141632 00000100:00100000:0.0:1787756360.045811:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787756360.045819:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:8476:x1874598287141632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787756360.046108:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:8476:x1874598287141632:12345-0@lo:502:llog_process_th.0 Request processed in 289us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.046115:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787756360.053767:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8476:1874598287141632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787756360.053821:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787756360.053845:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787756360.053847:0:8476:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787756360.053860:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787756360.053955:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787756360.053983:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787756360.053994:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af81542400/0x178386880caab118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab11f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.054005:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af81542400/0x178386880caab118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab11f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756360.054027:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787756360.054030:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98afb3fb3800 from 39 10000000:01000000:1.0:1787756360.054032:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787756360.054065:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afb3845e00/0x178386880caab126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.054073:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afb3845e00/0x178386880caab126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.054082:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afb3845e00/0x178386880caab126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756360.054102:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287141760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.054162:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.054209:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756360.054307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287141760 00000100:00100000:0.0:1787756360.054314:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287141760 00000100:00100000:0.0:1787756360.054361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787756360.054369:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+14:5839:x1874598287141760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787756360.054400:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756360.054412:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af81543000/0x178386880caab12d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab126 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.054433:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af81543000/0x178386880caab12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab126 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.054444:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af81543000/0x178386880caab12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab126 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.054453:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af81543000, rc 0) 00000100:00100000:0.0:1787756360.054501:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287141760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.054507:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787756360.054751:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287141760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787756360.054764:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afb3845e00/0x178386880caab126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab12d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.054771:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afb3845e00/0x178386880caab126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab12d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756360.054813:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287141888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.054867:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.054886:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756360.054968:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287141888 00000100:00100000:0.0:1787756360.054972:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287141888 00000100:00100000:0.0:1787756360.054998:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787756360.055003:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287141888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787756360.055307:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287141888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.055314:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787756360.055368:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287141888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.055406:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287142016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.055446:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.055467:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae8130acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756360.055550:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287142016 00000100:00100000:3.0:1787756360.055554:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287142016 00000100:00100000:3.0:1787756360.055580:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787756360.055585:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287142016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787756360.055727:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287142016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756360.055733:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787756360.055859:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287142016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787756360.061254:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8477:1874598287142144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787756360.061343:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756360.061401:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af83526240 going to sleep for 11 seconds 00000100:00100000:1.0:1787756360.061591:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287142144 00000100:00100000:1.0:1787756360.061598:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287142144 00000100:00100000:1.0:1787756360.061659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787756360.061667:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:8477:x1874598287142144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756360.061924:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:8477:x1874598287142144:12345-0@lo:502:llog_process_th.0 Request processed in 257us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756360.061933:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787756360.062312:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8477:1874598287142144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787756360.062369:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8477:1874598287142272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787756360.062481:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756360.062511:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af83526240 going to sleep for 11 seconds 00000100:00100000:1.0:1787756360.062553:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287142272 00000100:00100000:1.0:1787756360.062557:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287142272 00000100:00100000:1.0:1787756360.062590:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787756360.062598:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:8477:x1874598287142272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756360.062809:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:8477:x1874598287142272:12345-0@lo:502:llog_process_th.0 Request processed in 212us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756360.062816:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787756360.068299:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8477:1874598287142272:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787756360.068448:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787756360.068990:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787756360.069012:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787756360.069022:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afb3845e00/0x178386880caab126 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab12d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756360.069034:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afb3845e00/0x178386880caab126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab12d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756360.069044:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787756360.069047:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787756360.069050:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787756360.069085:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caab134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756360.069094:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caab134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756360.069104:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caab134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756360.069140:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287142400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787756360.069208:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756360.069246:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787756360.069351:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287142400 00000100:00100000:3.0:1787756360.069358:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287142400 00000100:00100000:3.0:1787756360.069406:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787756360.069415:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+15:5839:x1874598287142400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787756360.069428:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756360.069441:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da6e00/0x178386880caab13b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab134 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756360.069463:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da6e00/0x178386880caab13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab134 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756360.069473:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da6e00/0x178386880caab13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab134 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756360.069483:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da6e00, rc 0) 00000100:00100000:3.0:1787756360.069526:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287142400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756360.069534:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787756360.069804:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287142400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787756360.069817:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caab134 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab13b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756360.069826:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caab134 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab13b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756360.069909:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287142528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787756360.069934:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756360.069971:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787756360.070191:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287142528 00000100:00100000:3.0:1787756360.070196:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287142528 00000100:00100000:3.0:1787756360.070226:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787756360.070233:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287142528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756360.070473:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287142528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756360.070481:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787756360.070666:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287142528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.070697:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287142656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.070735:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.070763:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af856e80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756360.070804:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287142656 00000100:00100000:2.0:1787756360.070808:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287142656 00000100:00100000:2.0:1787756360.070860:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787756360.070867:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287142656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787756360.071005:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287142656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756360.071012:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787756360.071125:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287142656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.071492:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8478:1874598287142784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756360.071525:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.071551:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af856e80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756360.071591:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287142784 00000100:00100000:2.0:1787756360.071595:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287142784 00000100:00100000:2.0:1787756360.071635:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787756360.071643:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:8478:x1874598287142784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787756360.071765:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:8478:x1874598287142784:12345-0@lo:502:llog_process_th.0 Request processed in 122us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756360.071778:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787756360.071872:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8478:1874598287142784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787756360.071899:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787756360.071907:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756360.071910:0:8478:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787756360.071915:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787756360.071933:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8478:1874598287142912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756360.071974:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.071988:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbcd279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756360.075437:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287142912 00000100:00100000:3.0:1787756360.075451:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287142912 00000100:00100000:3.0:1787756360.075507:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787756360.075514:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:8478:x1874598287142912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787756360.075755:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:8478:x1874598287142912:12345-0@lo:502:llog_process_th.0 Request processed in 240us (3791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756360.075762:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787756360.076141:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8478:1874598287142912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787756360.076261:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787756360.076268:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756360.076270:0:8478:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787756360.076274:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787756360.076478:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787756360.076495:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787756360.076505:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caab134 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab13b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756360.076514:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc2044000/0x178386880caab134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab13b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756360.076522:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787756360.076525:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff98af903a6800 from 39 10000000:01000000:2.0:1787756360.076527:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787756360.076554:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2045000/0x178386880caab142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756360.076561:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc2045000/0x178386880caab142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756360.076568:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc2045000/0x178386880caab142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756360.076587:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787756360.076634:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756360.076666:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787756360.076709:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287143040 00000100:00100000:3.0:1787756360.076714:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287143040 00000100:00100000:3.0:1787756360.076745:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787756360.076751:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287143040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787756360.076759:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756360.076769:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da6600/0x178386880caab149 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab142 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756360.076787:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da6600/0x178386880caab149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab142 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756360.076796:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da6600/0x178386880caab149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab142 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756360.076817:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da6600, rc 0) 00000100:00100000:3.0:1787756360.076871:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287143040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756360.076877:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787756360.077568:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787756360.077583:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc2045000/0x178386880caab142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab149 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756360.077604:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc2045000/0x178386880caab142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab149 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756360.077662:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787756360.077691:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756360.077712:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787756360.077758:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287143168 00000100:00100000:3.0:1787756360.077762:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287143168 00000100:00100000:3.0:1787756360.077787:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787756360.077793:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287143168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756360.078628:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287143168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 831us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756360.078636:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787756360.079046:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787756360.079086:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787756360.079127:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756360.081891:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7a780 going to sleep for 11 seconds 00000100:00100000:1.0:1787756360.083010:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287143296 00000100:00100000:1.0:1787756360.083021:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287143296 00000100:00100000:1.0:1787756360.083079:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787756360.083089:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287143296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.083561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287143296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 473us (4433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756360.083569:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787756360.086164:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787756360.086668:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8479:1874598287143424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787756360.086728:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756360.086768:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfc7a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787756360.086823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287143424 00000100:00100000:3.0:1787756360.086863:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287143424 00000100:00100000:3.0:1787756360.086902:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787756360.086911:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:8479:x1874598287143424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787756360.087133:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:8479:x1874598287143424:12345-0@lo:502:llog_process_th.0 Request processed in 222us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756360.087141:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787756360.087306:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8479:1874598287143424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787756360.087345:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8479:1874598287143552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787756360.087377:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756360.087404:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af9191c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787756360.087446:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287143552 00000100:00100000:1.0:1787756360.087450:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287143552 00000100:00100000:1.0:1787756360.087480:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787756360.087486:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:8479:x1874598287143552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756360.087628:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:8479:x1874598287143552:12345-0@lo:502:llog_process_th.0 Request processed in 140us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756360.087635:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787756360.087731:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8479:1874598287143552:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787756360.087749:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787756360.087912:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787756360.087934:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787756360.087943:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2045000/0x178386880caab142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab149 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.087954:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc2045000/0x178386880caab142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab149 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756360.087974:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787756360.087977:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787756360.087980:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787756360.088002:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afb3844600/0x178386880caab150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.088010:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afb3844600/0x178386880caab150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.088019:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afb3844600/0x178386880caab150 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756360.088033:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.088059:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.088076:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbcd279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756360.088169:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287143680 00000100:00100000:3.0:1787756360.088174:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287143680 00000100:00100000:3.0:1787756360.088204:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787756360.088211:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287143680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787756360.088220:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756360.088231:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da6200/0x178386880caab157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab150 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756360.088264:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da6200/0x178386880caab157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab150 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756360.088274:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da6200/0x178386880caab157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab150 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756360.088282:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da6200, rc 0) 00000100:00100000:3.0:1787756360.088317:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287143680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756360.088323:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787756360.088383:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787756360.088395:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afb3844600/0x178386880caab150 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab157 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.088404:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afb3844600/0x178386880caab150 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab157 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756360.088443:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.088470:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.088490:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbcd279c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756360.088528:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287143808 00000100:00100000:3.0:1787756360.088531:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287143808 00000100:00100000:3.0:1787756360.088546:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787756360.088551:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287143808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756360.088747:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287143808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756360.088754:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787756360.088900:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.088924:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.088954:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.089254:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbcd279c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756360.089344:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287143936 00000100:00100000:0.0:1787756360.089349:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287143936 00000100:00100000:0.0:1787756360.089371:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787756360.089377:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287143936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787756360.089668:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287143936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 290us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.089676:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787756360.089820:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287143936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787756360.090359:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af88d93840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8480:1874598287144064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787756360.090573:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756360.090614:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afb37cfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787756360.090660:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287144064 00000100:00100000:0.0:1787756360.090666:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287144064 00000100:00100000:0.0:1787756360.090701:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787756360.090709:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:8480:x1874598287144064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787756360.091119:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:8480:x1874598287144064:12345-0@lo:502:llog_process_th.0 Request processed in 410us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.091127:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787756360.091206:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af88d93840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8480:1874598287144064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787756360.091235:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787756360.091243:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756360.091245:0:8480:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787756360.091250:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787756360.091270:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af88d93840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8480:1874598287144192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787756360.091310:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756360.091338:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afb37cfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787756360.091392:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287144192 00000100:00100000:1.0:1787756360.091397:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287144192 00000100:00100000:1.0:1787756360.091426:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787756360.091432:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:8480:x1874598287144192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756360.091566:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:8480:x1874598287144192:12345-0@lo:502:llog_process_th.0 Request processed in 133us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756360.091573:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787756360.091716:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af88d93840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8480:1874598287144192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787756360.091734:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787756360.091738:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787756360.091740:0:8480:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787756360.091743:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787756360.092035:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787756360.092053:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787756360.092062:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afb3844600/0x178386880caab150 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab157 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.092074:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afb3844600/0x178386880caab150 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab157 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756360.092084:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787756360.092086:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff98af87ff1a48 from 1 10000000:01000000:1.0:1787756360.092089:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787756360.092156:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afb3845200/0x178386880caab15e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.092171:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afb3845200/0x178386880caab15e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756360.092182:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afb3845200/0x178386880caab15e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756360.092198:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287144320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787756360.092231:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.092259:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbcd279c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756360.092301:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287144320 00000100:00100000:0.0:1787756360.092305:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287144320 00000100:00100000:0.0:1787756360.092337:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787756360.092344:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287144320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787756360.092352:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756360.092364:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af81542a00/0x178386880caab165 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab15e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.092443:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af81542a00/0x178386880caab165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab15e expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.092455:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af81542a00/0x178386880caab165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab15e expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756360.092462:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af81542a00, rc 0) 00000100:00100000:0.0:1787756360.092532:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287144320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.092538:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787756360.095170:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287144320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787756360.095196:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afb3845200/0x178386880caab15e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab165 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756360.095221:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afb3845200/0x178386880caab15e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab165 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756360.095389:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af88d93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287144448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756360.095447:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756360.095489:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afb37cfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787756360.095565:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287144448 00000100:00100000:2.0:1787756360.095571:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287144448 00000100:00100000:2.0:1787756360.095618:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787756360.095626:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287144448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787756360.095902:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287144448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (453us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787756360.095910:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787756360.096225:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af88d93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287144448:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787756360.096254:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787756360.096260:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afb3845200/0x178386880caab15e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab165 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756360.096270:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afb3845200/0x178386880caab15e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab165 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756360.216082:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787756360.217308:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287144576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756360.217383:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756360.217484:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287144576 00000100:00100000:0.0:1787756360.217494:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287144576 00000100:00100000:0.0:1787756360.217566:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787756360.217575:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287144576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787756360.217623:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756360.217675:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287144576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.217682:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787756360.217724:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca0f00 x1874598287144576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756360.217744:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287144576:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787756360.217821:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787756360.218088:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287144960:0@lo:400:kworker.0 00000100:00100000:2.0:1787756360.218125:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756360.218150:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787756360.218156:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287144832:0@lo:400:kworker.0 00000100:00100000:2.0:1787756360.218190:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756360.218216:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287144960 00000100:00100000:2.0:1787756360.218220:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287144960 00000100:00100000:2.0:1787756360.218256:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287144832 00000100:00100000:2.0:1787756360.218258:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287144832 00000100:00100000:2.0:1787756360.218279:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787756360.218288:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287144960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756360.218305:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787756360.218316:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287144832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756360.218333:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287144960:12345-0@lo:400:kworker.0 Request processed in 46us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756360.218340:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787756360.218362:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287144832:12345-0@lo:400:kworker.0 Request processed in 48us (170us total) trans 0 rc 0/0 00000100:00080000:2.0:1787756360.218363:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787756360.218372:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787756360.218388:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287144832:0@lo:400:kworker.0 00000100:00100000:2.0:1787756360.218417:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287144960:0@lo:400:kworker.0 00000100:00100000:0.0:1787756360.218733:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287144704:0@lo:400:kworker.0 00000100:00100000:0.0:1787756360.218768:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756360.218797:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287145088:0@lo:400:kworker.0 00000100:00100000:0.0:1787756360.218808:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287145216:0@lo:400:kworker.0 00000100:00100000:0.0:1787756360.218865:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756360.218876:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756360.218924:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287144704 00000100:00100000:1.0:1787756360.218929:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287144704 00000100:00100000:2.0:1787756360.218940:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287145216 00000100:00100000:2.0:1787756360.218946:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287145216 00000100:00100000:1.0:1787756360.218960:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787756360.218970:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287144704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756360.218990:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787756360.219000:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287145216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787756360.223680:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787756360.223716:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287145088 00000100:00100000:0.0:1787756360.223726:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287145088 00000100:00100000:0.0:1787756360.223786:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787756360.223795:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af88d93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287145088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756360.223882:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af88d93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287145088:12345-0@lo:400:kworker.0 Request processed in 88us (5009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.223889:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787756360.223904:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787756360.226080:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287145088:0@lo:400:kworker.0 00000100:00100000:1.0:1787756360.226087:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287144704:12345-0@lo:400:kworker.0 Request processed in 7115us (7313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756360.226099:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787756360.226115:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287144704:0@lo:400:kworker.0 00000100:00100000:2.0:1787756360.226205:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287145216:12345-0@lo:400:kworker.0 Request processed in 7205us (7338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756360.226215:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787756360.226276:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99aa8000 x1874598287145216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756360.226289:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287145216:0@lo:400:kworker.0 00000100:00100000:0.0:1787756360.730971:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287145344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787756360.731039:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756360.731119:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287145344 00000100:00100000:0.0:1787756360.731126:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287145344 00000100:00100000:0.0:1787756360.731184:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787756360.731193:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287145344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787756360.731226:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756360.731271:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287145344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756360.731278:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787756360.731319:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c79a40 x1874598287145344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756360.731336:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287145344:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787756360.855992:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756361.642297:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756361.642341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756361.642376:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756361.642420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756361.642456:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264050176 00000100:00100000:0.0:1787756361.642464:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264050176 00000100:00100000:2.0:1787756361.642487:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264050048 00000100:00100000:2.0:1787756361.642493:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264050048 00000100:00100000:0.0:1787756361.642521:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264050304 00000100:00100000:0.0:1787756361.642526:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264050304 00000100:00100000:2.0:1787756361.642543:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:2.0:1787756361.642556:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:2365:x1874598264050048:12345-192.168.203.21@tcp:400: 00000100:00100000:0.0:1787756361.642562:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:0.0:1787756361.642573:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcdd3d25-193d-42cb-911a-069eb2969705+5:2365:x1874598264050176:12345-192.168.203.21@tcp:400: 00000100:00100000:2.0:1787756361.642659:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:2365:x1874598264050048:12345-192.168.203.21@tcp:400: Request processed in 107us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756361.642668:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:2.0:1787756361.642700:0:6693:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787756361.642707:0:6693:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787756361.643158:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787756361.643183:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1787756361.643191:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcdd3d25-193d-42cb-911a-069eb2969705+5:2365:x1874598264050304:12345-192.168.203.21@tcp:400: 00000100:00100000:3.0:1787756361.643307:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264049920 00000100:00100000:3.0:1787756361.643313:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264049920 00000100:00100000:3.0:1787756361.643345:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 162 00000100:00100000:3.0:1787756361.643352:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+8:2365:x1874598264049920:12345-192.168.203.21@tcp:400: 00000100:00100000:0.0:1787756361.645883:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcdd3d25-193d-42cb-911a-069eb2969705+5:2365:x1874598264050176:12345-192.168.203.21@tcp:400: Request processed in 3301us (3530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756361.645899:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00080000:0.0:1787756361.645938:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787756361.645943:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787756361.645946:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787756361.651513:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcdd3d25-193d-42cb-911a-069eb2969705+5:2365:x1874598264050304:12345-192.168.203.21@tcp:400: Request processed in 8311us (9080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756361.651528:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:3.0:1787756361.660803:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+8:2365:x1874598264049920:12345-192.168.203.21@tcp:400: Request processed in 17439us (18504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756361.660827:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 162 00010000:00010000:2.0:1787756361.880064:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756362.904160:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756363.928081:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756364.952172:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756365.336142:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287145472:0@lo:400:kworker.0 00000100:00100000:1.0:1787756365.336234:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756365.337013:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287145472 00000100:00100000:3.0:1787756365.337022:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287145472 00000100:00100000:3.0:1787756365.337071:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787756365.337079:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3310:x1874598287145472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756365.339394:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287145984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756365.339477:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756365.340213:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287145856:0@lo:400:kworker.0 00000100:00100000:0.0:1787756365.340253:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756365.342366:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287145600:0@lo:400:kworker.0 00000100:00100000:2.0:1787756365.342438:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756365.342474:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287146112:0@lo:400:kworker.0 00000100:00100000:2.0:1787756365.342498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756365.342541:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787756365.342549:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287145728:0@lo:400:kworker.0 00000100:00100000:2.0:1787756365.342593:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756365.342613:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287146240:0@lo:400:kworker.0 00000100:00100000:2.0:1787756365.342646:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756365.342678:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287145600 00000100:00100000:2.0:1787756365.342686:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287145600 00000100:00100000:2.0:1787756365.342733:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287146112 00000100:00100000:2.0:1787756365.342736:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287146112 00000100:00100000:2.0:1787756365.342757:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287145728 00000100:00100000:2.0:1787756365.342760:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287145728 00000100:00100000:2.0:1787756365.342776:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787756365.342783:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287145600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756365.343187:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287145856 00000100:00100000:0.0:1787756365.343203:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287145856 00000100:00100000:0.0:1787756365.343240:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287146240 00000100:00100000:0.0:1787756365.343243:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287146240 00000100:00100000:0.0:1787756365.343265:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787756365.343274:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287145856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756365.346416:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3310:x1874598287145472:12345-0@lo:400:kworker.0 Request processed in 9327us (10172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756365.346431:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787756365.346530:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787756365.346546:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287146112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756365.346732:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aaa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287145600:12345-0@lo:400:kworker.0 Request processed in 3947us (4293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756365.346740:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787756365.346760:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787756365.346769:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287145728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756365.348615:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287145728:12345-0@lo:400:kworker.0 Request processed in 48us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756365.348631:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787756365.348722:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287145728:0@lo:400:kworker.0 00000100:00100000:2.0:1787756365.348736:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287145600:0@lo:400:kworker.0 00000100:00080000:2.0:1787756365.348799:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787756365.348806:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787756365.348809:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787756365.349025:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787756365.349057:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287146240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756365.349140:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287146240:12345-0@lo:400:kworker.0 Request processed in 89us (6493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756365.349147:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787756365.349412:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c71680 x1874598287146240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756365.349424:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287146240:0@lo:400:kworker.0 00000100:00100000:2.0:1787756365.349459:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287145984 00000100:00100000:2.0:1787756365.349465:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287145984 00000100:00100000:2.0:1787756365.349501:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787756365.349508:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874598287145984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787756365.349540:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787756365.349588:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c62940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874598287145984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (10110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756365.349595:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787756365.350424:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c72940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287145856:12345-0@lo:400:kworker.0 Request processed in 7148us (10166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756365.350435:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787756365.350749:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c71a40 x1874598287145856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756365.350763:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287145856:0@lo:400:kworker.0 00000100:00100000:3.0:1787756365.352383:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287146112:12345-0@lo:400:kworker.0 Request processed in 5839us (9878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756365.352394:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787756365.352636:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287146112:0@lo:400:kworker.0 00000100:00100000:1.0:1787756365.352861:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287145472:0@lo:400:kworker.0 00010000:00080000:1.0:1787756365.352896:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99aab480 x1874598287145984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756365.352915:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287145984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787756365.737976:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756365.738077:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264050432 00000100:00100000:3.0:1787756365.738086:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264050432 00000100:00100000:3.0:1787756365.738148:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 164 00000100:00100000:3.0:1787756365.738158:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+8:5605:x1874598264050432:12345-192.168.203.21@tcp:101: 00010000:00010000:3.0:1787756365.738176:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756365.738193:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da6400/0x178386880caab16c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a22 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756365.738223:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da6400/0x178386880caab16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a22 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756365.738235:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da6400/0x178386880caab16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a22 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756365.738264:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da6400, rc 0) 00000100:00100000:3.0:1787756365.738318:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+9:5605:x1874598264050432:12345-192.168.203.21@tcp:101: Request processed in 161us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756365.738326:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 164 00000100:00100000:0.0:1787756365.741647:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756365.744359:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264050560 00000100:00100000:3.0:1787756365.744374:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264050560 00000100:00100000:3.0:1787756365.744488:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 165 00000100:00100000:3.0:1787756365.744500:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+9:5605:x1874598264050560:12345-192.168.203.21@tcp:501: 00000100:00100000:3.0:1787756365.744861:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+9:5605:x1874598264050560:12345-192.168.203.21@tcp:501: Request processed in 361us (3221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756365.744870:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 165 00000100:00100000:0.0:1787756365.751426:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756365.755297:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264050688 00000100:00100000:1.0:1787756365.755396:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264050688 00000100:00100000:1.0:1787756365.755596:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 166 00000100:00100000:1.0:1787756365.755610:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+9:5605:x1874598264050688:12345-192.168.203.21@tcp:503: 00000100:00100000:1.0:1787756365.755999:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+9:5605:x1874598264050688:12345-192.168.203.21@tcp:503: Request processed in 391us (4582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756365.756009:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 166 00000100:00100000:2.0:1787756365.761699:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756365.762030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264050816 00000100:00100000:3.0:1787756365.762039:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264050816 00000100:00100000:3.0:1787756365.762099:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 167 00000100:00100000:3.0:1787756365.762108:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+9:6107:x1874598264050816:12345-192.168.203.21@tcp:502: 00000100:00100000:3.0:1787756365.762395:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+9:6107:x1874598264050816:12345-192.168.203.21@tcp:502: Request processed in 286us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756365.762403:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 167 00000100:00100000:0.0:1787756365.774830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756365.774979:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264050944 00000100:00100000:1.0:1787756365.774988:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264050944 00000100:00100000:1.0:1787756365.775040:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 168 00000100:00100000:1.0:1787756365.775049:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+9:6107:x1874598264050944:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787756365.775339:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+9:6107:x1874598264050944:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 289us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756365.775347:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 168 00000100:00100000:2.0:1787756365.783987:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756365.784236:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264051072 00000100:00100000:0.0:1787756365.784245:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264051072 00000100:00100000:0.0:1787756365.784307:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 169 00000100:00100000:0.0:1787756365.784318:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+9:5605:x1874598264051072:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787756365.784335:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756365.784353:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af81542200/0x178386880caab173 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a29 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756365.784382:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af81542200/0x178386880caab173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a29 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756365.784395:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af81542200/0x178386880caab173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a29 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756365.784404:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af81542200, rc 0) 00000100:00100000:0.0:1787756365.784477:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264051072:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 161us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756365.784484:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 169 00000100:00100000:2.0:1787756365.794447:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756365.796358:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264051200 00000100:00100000:3.0:1787756365.796372:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264051200 00000100:00100000:3.0:1787756365.796442:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 170 00000100:00100000:3.0:1787756365.796452:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264051200:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756365.796745:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264051200:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 292us (2307us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787756365.796763:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 170 00000100:00100000:2.0:1787756365.850010:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287146368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787756365.850074:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756365.850231:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287146368 00000100:00100000:0.0:1787756365.850238:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287146368 00000100:00100000:0.0:1787756365.850283:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787756365.850291:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287146368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787756365.850321:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756365.850378:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287146368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756365.850386:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787756365.850418:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c70b40 x1874598287146368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756365.850435:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287146368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787756365.976044:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756366.764383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756366.764475:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756366.764506:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264051456 00000100:00100000:3.0:1787756366.764516:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264051456 00000100:00100000:3.0:1787756366.764586:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:3.0:1787756366.764595:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:2363:x1874598264051456:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787756366.765909:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:2363:x1874598264051456:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 1309us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756366.765920:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00080000:3.0:1787756366.765952:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787756366.772214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756366.772256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756366.772345:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264051328 00000100:00100000:1.0:1787756366.772355:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264051328 00000100:00100000:1.0:1787756366.775904:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 171 00000100:00100000:1.0:1787756366.775924:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264051328:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787756366.776063:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264051328:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 145us (11687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756366.776131:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 171 00000100:00100000:0.0:1787756366.777328:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264051584 00000100:00100000:0.0:1787756366.777338:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264051584 00000100:00080000:1.0:1787756366.777392:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787756366.777417:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264051712 00000100:00100000:0.0:1787756366.777421:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264051712 00000100:00100000:2.0:1787756366.777454:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00080000:1.0:1787756366.777482:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787756366.778235:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcdd3d25-193d-42cb-911a-069eb2969705+5:2363:x1874598264051584:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787756366.778316:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcdd3d25-193d-42cb-911a-069eb2969705+5:2363:x1874598264051584:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 853us (6110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756366.783555:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:2.0:1787756366.783606:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:0.0:1787756366.784538:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcdd3d25-193d-42cb-911a-069eb2969705+5:2363:x1874598264051712:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787756366.784672:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcdd3d25-193d-42cb-911a-069eb2969705+5:2363:x1874598264051712:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 148us (12414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756366.784680:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00010000:00010000:2.0:1787756367.000179:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787756367.154712:0:8521:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff62a81e50 20000000:00000080:1.0:1787756367.154729:0:8521:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98afbb42cc00 uarg=0000000000000000 20000000:01000000:1.0:1787756367.154818:0:8521:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787756367.154824:0:8521:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787756367.154828:0:8521:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787756367.156812:0:8522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787756367.157083:0:8521:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787756367.162986:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787756367.163042:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787756367.163099:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787756367.163116:0:8521:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787756367.163135:0:8521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.163152:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98afc2044c00/0x178386880caaaeef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaee8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.163159:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af84da7a00/0x178386880caaaf51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caaaf4a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.163166:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af84da6800/0x178386880caab01c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab015 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.163182:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af80031400/0x178386880caab0d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69f1 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.163190:0:8521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.163223:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af80031400/0x178386880caab0d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69f1 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.163236:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98af80031400/0x178386880caab0d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69f1 expref: 9 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756367.163250:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c70b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1874598287146496:192.168.203.21@tcp:104: 00010000:00010000:0.0:1787756367.163402:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af84da6800/0x178386880caab01c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caab015 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.163412:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af84da6800/0x178386880caab01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caab015 expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756367.163422:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1874598287146624:0@lo:104: 00000100:00100000:0.0:1787756367.163460:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756367.163483:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287146624 00000100:00100000:3.0:1787756367.163491:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287146624 00010000:00010000:0.0:1787756367.163495:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af84da7a00/0x178386880caaaf51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaaf4a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.163505:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af84da7a00/0x178386880caaaf51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaaf4a expref: 18 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756367.163515:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c71680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1874598287146752:0@lo:104: 00000100:00100000:0.0:1787756367.163553:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787756367.164742:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98afc2044c00/0x178386880caaaeef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caaaee8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.164755:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98afc2044c00/0x178386880caaaeef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caaaee8 expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756367.164767:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c703c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1874598287146880:0@lo:104: 00000100:00100000:0.0:1787756367.164795:0:8521:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbccc5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756367.164820:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787756367.164877:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:2.0:1787756367.164884:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287146752 00000100:00100000:2.0:1787756367.164888:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287146752 00000100:00100000:2.0:1787756367.164918:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787756367.164926:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:8521:x1874598287146624:12345-0@lo:104: 00010000:00010000:2.0:1787756367.164939:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756367.165107:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756367.165119:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787756367.165124:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1787756367.165487:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787756367.165494:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:8521:x1874598287146624:12345-0@lo:104: Request processed in 568us (2034us total) trans 0 rc 0/0 00010000:00010000:1.0:1787756367.165497:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787756367.165506:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787756367.165508:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.165519:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc21ce600 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:1.0:1787756367.165523:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756367.165526:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287146880 00000100:00100000:2.0:1787756367.165532:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287146880 00010000:00010000:1.0:1787756367.165535:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756367.165551:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 10000000:00010000:1.0:1787756367.165573:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756367.165579:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbb71b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:8521:x1874598287146752:12345-0@lo:104: 10000000:01000000:1.0:1787756367.165585:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787756367.165593:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.165624:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.165631:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787756367.165632:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787756367.165645:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbb71b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:8521:x1874598287146752:12345-0@lo:104: Request processed in 86us (2092us total) trans 0 rc 0/0 00010000:00010000:1.0:1787756367.165652:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756367.165653:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787756367.165662:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc21ce600/0x178386880caab015 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab01c expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.165676:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787756367.165679:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.165684:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc21cf800 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:1.0:1787756367.165687:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.165693:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787756367.165699:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787756367.165704:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787756367.165726:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.165744:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787756367.165759:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.165766:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc21cf800/0x178386880caaaf4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaf51 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.165776:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756367.165778:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756367.165780:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756367.165791:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287147008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787756367.165824:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756367.165888:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287147136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787756367.165916:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756367.165924:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787756367.165934:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c783c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:8521:x1874598287146880:12345-0@lo:104: 00010000:00010000:2.0:1787756367.165943:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98afc21cf200/0x178386880caaaee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756367.165947:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287147008 00000100:00100000:1.0:1787756367.165953:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287147008 00010000:00010000:1.0:1787756367.165978:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af84da6800/0x178386880caab01c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab015 expref: 19 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756367.165986:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787756367.165992:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c783c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:8521:x1874598287146880:12345-0@lo:104: Request processed in 61us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756367.166000:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787756367.166002:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287147136 00000100:00100000:1.0:1787756367.166007:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287147136 00010000:00010000:2.0:1787756367.166017:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787756367.166022:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af84da7a00/0x178386880caaaf51 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf4a expref: 20 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756367.166025:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98afc21cf200/0x178386880caaaee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756367.166039:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc21cf200 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756367.166043:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98afc21cf200/0x178386880caaaee8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756367.166051:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98afc21cf200/0x178386880caaaee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756367.166052:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787756367.166063:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c62d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+20:3310:x1874598287147008:12345-0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1787756367.166064:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98afc21cf200/0x178386880caaaee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756367.166074:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787756367.166076:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787756367.166091:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af84da6800/0x178386880caab01c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab015 expref: 20 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756367.166092:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98afc21cf200/0x178386880caaaee8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.166105:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af84da6800/0x178386880caab01c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caab015 expref: 20 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.166130:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787756367.166133:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787756367.166151:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98afc21cf200/0x178386880caaaee8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756367.166159:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98afc21cf200/0x178386880caaaee8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caaaeef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756367.166164:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c62d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+20:3310:x1874598287147008:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756367.166176:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787756367.166181:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756367.166185:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756367.166186:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756367.166192:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756367.166193:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787756367.166202:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3311:x1874598287147136:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787756367.166207:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287147264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787756367.166212:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787756367.166218:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af84da7a00/0x178386880caaaf51 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaf4a expref: 19 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.166227:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af84da7a00/0x178386880caaaf51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaaf4a expref: 19 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756367.166249:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756367.166278:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287147264 00000100:00100000:2.0:1787756367.166281:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287147264 00010000:00010000:2.0:1787756367.166305:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98afc2044c00/0x178386880caaaeef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaee8 expref: 20 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.166310:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787756367.166322:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787756367.166330:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+20:3312:x1874598287147264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787756367.166337:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787756367.166342:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98afc2044c00/0x178386880caaaeef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caaaee8 expref: 20 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756367.166348:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+20:3311:x1874598287147136:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (429us total) trans 0 rc 0/0 00010000:00010000:2.0:1787756367.166359:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98afc2044c00/0x178386880caaaeef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caaaee8 expref: 20 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756367.166360:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1787756367.166375:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787756367.166402:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287147008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787756367.166423:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287147264:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756367.166430:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787756367.166455:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287147136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787756367.166477:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287147264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787756367.167125:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da6800/0x178386880caab01c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caab015 expref: 18 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756367.167139:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1874598287146624:0@lo:104: 00010000:00010000:3.0:1787756367.167152:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da7a00/0x178386880caaaf51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaaf4a expref: 17 pid: 5835 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756367.167161:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c71680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1874598287146752:0@lo:104: 00010000:00010000:3.0:1787756367.167169:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afc2044c00/0x178386880caaaeef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caaaee8 expref: 16 pid: 5837 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756367.167185:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c703c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1874598287146880:0@lo:104: 00000100:00100000:2.0:1787756367.170598:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756367.170674:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264051840 00000100:00100000:1.0:1787756367.170683:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264051840 00010000:00010000:1.0:1787756367.170719:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af80031400/0x178386880caab0d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69f1 expref: 10 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756367.170769:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:1.0:1787756367.170790:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2365:x1874598264051840:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787756367.170805:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787756367.170810:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af80031400/0x178386880caab0d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69f1 expref: 10 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.170823:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af80031400/0x178386880caab0d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69f1 expref: 10 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.170871:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756367.170883:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.170973:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.170983:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.170990:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.170997:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.171003:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81543a00 already unused, calling callback (ffffffffc162d530) 00010000:00010000:0.0:1787756367.171007:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.171014:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.171023:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756367.171033:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756367.171099:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2365:x1874598264051840:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 309us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756367.171108:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 24 00010000:00010000:3.0:1787756367.171225:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af80031400/0x178386880caab0d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa69f1 expref: 9 pid: 5837 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756367.171240:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c70b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1874598287146496:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787756367.171270:0:8521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756367.171279:0:8521:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756367.171287:0:8521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756367.172047:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af81543a00/0x178386880caab17a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756367.785938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756367.786133:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264051968 00000100:00100000:3.0:1787756367.786143:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264051968 00000100:00100000:3.0:1787756367.786199:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 172 00000100:00100000:3.0:1787756367.786209:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+9:5605:x1874598264051968:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787756367.786228:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756367.786247:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da7a00/0x178386880caab181 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a30 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756367.786274:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da7a00/0x178386880caab181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a30 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756367.786300:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da7a00/0x178386880caab181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a30 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756367.786309:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7a00, rc 0) 00000100:00100000:3.0:1787756367.786367:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264051968:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 159us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756367.786375:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 172 00000100:00100000:2.0:1787756367.794409:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756367.794724:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264052096 00000100:00100000:3.0:1787756367.794733:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264052096 00000100:00100000:3.0:1787756367.794784:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 173 00000100:00100000:3.0:1787756367.794794:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264052096:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756367.796755:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264052096:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 1953us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756367.796768:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 173 00000100:00100000:1.0:1787756367.803466:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756367.803525:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264052224 00000100:00100000:3.0:1787756367.803533:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264052224 00000100:00100000:3.0:1787756367.803590:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 174 00000100:00100000:3.0:1787756367.803599:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264052224:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787756367.803804:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264052224:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 205us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756367.803812:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 174 00000100:00100000:1.0:1787756367.809510:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756367.809655:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264052352 00000100:00100000:3.0:1787756367.809665:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264052352 00000100:00100000:3.0:1787756367.809723:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 175 00000100:00100000:3.0:1787756367.809732:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:6164:x1874598264052352:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787756367.809995:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:6164:x1874598264052352:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 263us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756367.810004:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 175 00000100:00100000:2.0:1787756367.816602:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756367.816671:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264052480 00000100:00100000:1.0:1787756367.816680:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264052480 00000100:00100000:1.0:1787756367.816732:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 176 00000100:00100000:1.0:1787756367.816740:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:6164:x1874598264052480:12345-192.168.203.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787756367.817000:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:6164:x1874598264052480:12345-192.168.203.21@tcp:502:llog_process_th.0 Request processed in 260us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756367.817009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 176 00010000:00010000:2.0:1787756368.027425:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787756368.599946:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787756368.599954:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98af85ba0800 from 4 10000000:01000000:0.0:1787756368.599959:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787756368.600008:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.600021:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.600033:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756368.600063:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287147392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.600136:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756368.600196:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae82d8d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787756368.600270:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287147392 00000100:00100000:3.0:1787756368.600278:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287147392 00000100:00100000:3.0:1787756368.600331:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787756368.600341:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287147392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787756368.600354:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756368.600367:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da7000/0x178386880caab18f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab188 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756368.600388:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da7000/0x178386880caab18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab188 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756368.600398:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da7000/0x178386880caab18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab188 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756368.600406:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7000, rc 0) 00000100:00100000:3.0:1787756368.600443:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287147392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756368.600449:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787756368.601719:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287147392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787756368.601747:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.601758:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756368.601827:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287147520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.601888:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756368.601959:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae82d8d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787756368.611490:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287147520 00000100:00100000:3.0:1787756368.611507:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287147520 00000100:00100000:3.0:1787756368.611574:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787756368.611584:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287147520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756368.617200:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287147520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5609us (15303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756368.617228:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787756368.617514:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287147520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.617598:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287147648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.617648:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756368.617687:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae82d8d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787756368.617705:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287147648 00000100:00100000:3.0:1787756368.617713:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287147648 00000100:00100000:3.0:1787756368.617775:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787756368.617784:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287147648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787756368.618000:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287147648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756368.618009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787756368.618309:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287147648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787756368.619597:0:8596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8596:1874598287147776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787756368.619668:0:8596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756368.619718:0:8596:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbb6a2780 going to sleep for 11 seconds 00000100:00100000:3.0:1787756368.619817:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287147776 00000100:00100000:3.0:1787756368.619823:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287147776 00000100:00100000:3.0:1787756368.619884:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787756368.619893:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:8596:x1874598287147776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787756368.620082:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:8596:x1874598287147776:12345-0@lo:502:llog_process_th.0 Request processed in 189us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756368.620090:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787756368.623063:0:8596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8596:1874598287147776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787756368.623110:0:8596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787756368.623120:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787756368.623122:0:8596:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787756368.623131:0:8596:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98af85ba0800 00000020:00000080:2.0:1787756368.623134:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787756368.623221:0:8596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8596:1874598287147904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787756368.623289:0:8596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756368.623330:0:8596:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbb6a2780 going to sleep for 11 seconds 00000100:00100000:0.0:1787756368.623331:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287147904 00000100:00100000:0.0:1787756368.623339:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287147904 00000100:00100000:0.0:1787756368.623397:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787756368.623405:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:8596:x1874598287147904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787756368.623603:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:8596:x1874598287147904:12345-0@lo:502:llog_process_th.0 Request processed in 198us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756368.623611:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787756368.624656:0:8596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8596:1874598287147904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787756368.624690:0:8596:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787756368.624698:0:8596:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787756368.624700:0:8596:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787756368.624706:0:8596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787756368.625648:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787756368.625668:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787756368.625678:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.625688:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787756368.625699:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787756368.625701:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98afb3fb3800 from 4 10000000:01000000:0.0:1787756368.625703:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787756368.625747:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.625754:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.625778:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756368.625800:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.625871:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756368.625910:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae82d8d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787756368.625984:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287148032 00000100:00100000:2.0:1787756368.625991:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287148032 00000100:00100000:2.0:1787756368.626039:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787756368.626048:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287148032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787756368.626060:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756368.626073:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98afc2045a00/0x178386880caab19d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab196 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756368.626096:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afc2045a00/0x178386880caab19d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab196 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756368.626106:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98afc2045a00/0x178386880caab19d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab196 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756368.626114:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2045a00, rc 0) 00000100:00100000:2.0:1787756368.626149:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287148032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756368.626156:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787756368.626338:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787756368.626353:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.626362:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756368.626407:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.626432:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756368.626464:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae82d8d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787756368.626478:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287148160 00000100:00100000:0.0:1787756368.626483:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287148160 00000100:00100000:0.0:1787756368.626508:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787756368.626515:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287148160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.627023:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287148160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 507us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756368.627031:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787756368.627068:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.627098:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.627142:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756368.627158:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae82d8d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787756368.627170:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287148288 00000100:00100000:0.0:1787756368.627174:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287148288 00000100:00100000:0.0:1787756368.627199:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787756368.627206:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287148288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.627349:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287148288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756368.627356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787756368.627391:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.630288:0:8597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8597:1874598287148416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787756368.630371:0:8597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756368.630418:0:8597:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae82d8d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787756368.630442:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287148416 00000100:00100000:1.0:1787756368.630450:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287148416 00000100:00100000:1.0:1787756368.632252:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787756368.632269:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:8597:x1874598287148416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756368.632582:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:8597:x1874598287148416:12345-0@lo:502:llog_process_th.0 Request processed in 319us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756368.632590:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787756368.633514:0:8597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8597:1874598287148416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787756368.633572:0:8597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787756368.633582:0:8597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787756368.633584:0:8597:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787756368.633593:0:8597:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98afb3fb3800 00000020:00000080:2.0:1787756368.633596:0:8597:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787756368.635503:0:8597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8597:1874598287148544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787756368.635966:0:8597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756368.639369:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287148544 00000100:00100000:0.0:1787756368.639383:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287148544 00000100:00100000:0.0:1787756368.639430:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787756368.639440:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:8597:x1874598287148544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787756368.639483:0:8597:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbb6a26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756368.639702:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:8597:x1874598287148544:12345-0@lo:502:llog_process_th.0 Request processed in 263us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756368.639710:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787756368.640008:0:8597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8597:1874598287148544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787756368.640052:0:8597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787756368.640060:0:8597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787756368.640063:0:8597:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787756368.640070:0:8597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787756368.641854:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787756368.641880:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787756368.641892:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.641905:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787756368.641925:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787756368.641927:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98af903a6800 from 4 10000000:01000000:0.0:1787756368.641930:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787756368.641966:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.641974:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.641984:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756368.642008:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.642065:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756368.642102:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae82d8d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787756368.642118:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287148672 00000100:00100000:0.0:1787756368.642124:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287148672 00000100:00100000:0.0:1787756368.649120:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787756368.649133:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287148672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787756368.649150:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756368.649168:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af81543c00/0x178386880caab1ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab1a4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.649196:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af81543c00/0x178386880caab1ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab1a4 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.649208:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af81543c00/0x178386880caab1ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab1a4 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.649229:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af81543c00, rc 0) 00000100:00100000:0.0:1787756368.649306:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287148672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (7240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756368.649314:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787756368.649357:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787756368.649375:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756368.649385:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756368.649451:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787756368.649489:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756368.649520:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae82d8d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787756368.650600:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287148800 00000100:00100000:1.0:1787756368.650609:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287148800 00000100:00100000:1.0:1787756368.650640:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787756368.650648:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287148800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787756368.652889:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287148800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2232us (3390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756368.652904:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787756368.652973:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787756368.653435:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787756368.653493:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756368.653520:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae81d96540 going to sleep for 11 seconds 00000100:00100000:1.0:1787756368.653533:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287148928 00000100:00100000:1.0:1787756368.653537:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287148928 00000100:00100000:1.0:1787756368.653592:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787756368.653602:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287148928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787756368.653789:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287148928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756368.653798:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787756368.653936:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287148928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787756368.654190:0:8601:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8601:1874598287149056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756368.654225:0:8601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756368.654254:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287149056 00000100:00100000:1.0:1787756368.654258:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287149056 00000100:00100000:1.0:1787756368.654285:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787756368.654292:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:8601:x1874598287149056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756368.654487:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:8601:x1874598287149056:12345-0@lo:502:llog_process_th.0 Request processed in 194us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756368.654494:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787756368.654528:0:8601:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae81d96b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787756368.654542:0:8601:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8601:1874598287149056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787756368.654573:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787756368.654582:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756368.654584:0:8601:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787756368.654592:0:8601:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff98af903a6800 00000020:00000080:1.0:1787756368.654594:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787756368.654661:0:8601:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8601:1874598287149184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756368.654693:0:8601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756368.654711:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287149184 00000100:00100000:1.0:1787756368.654714:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287149184 00000100:00100000:1.0:1787756368.654735:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787756368.654741:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:8601:x1874598287149184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787756368.654934:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85bc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:8601:x1874598287149184:12345-0@lo:502:llog_process_th.0 Request processed in 191us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756368.654940:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787756368.654970:0:8601:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae81d96b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787756368.654982:0:8601:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c621c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:8601:1874598287149184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787756368.654999:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787756368.655008:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787756368.655010:0:8601:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787756368.655014:0:8601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787756368.655128:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787756368.655145:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787756368.655153:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756368.655164:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756369.049022:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756370.073305:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756370.455962:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787756370.455987:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287149312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756370.456059:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756370.456125:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287149312 00000100:00100000:1.0:1787756370.456132:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287149312 00000100:00100000:1.0:1787756370.456235:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787756370.456244:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287149312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787756370.456279:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787756370.456321:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c61e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287149312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756370.456329:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787756370.456348:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787756370.456374:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c60f00 x1874598287149312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756370.456392:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287149312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756370.464504:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287149440:0@lo:400:kworker.0 00000100:00100000:1.0:1787756370.464587:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756370.464739:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287149440 00000100:00100000:3.0:1787756370.464747:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287149440 00000100:00100000:3.0:1787756370.464795:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787756370.464806:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3310:x1874598287149440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756370.467198:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874598287149696:0@lo:400:kworker.0 00000100:00100000:0.0:1787756370.467260:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756370.467307:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787756370.467314:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874598287149568:0@lo:400:kworker.0 00000100:00100000:0.0:1787756370.467338:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756370.467381:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287149824:0@lo:400:kworker.0 00000100:00100000:0.0:1787756370.467422:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756370.469070:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287149696 00000100:00100000:2.0:1787756370.469081:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287149696 00000100:00100000:2.0:1787756370.469133:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287149568 00000100:00100000:2.0:1787756370.469136:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287149568 00000100:00100000:2.0:1787756370.469150:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287149824 00000100:00100000:2.0:1787756370.469153:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287149824 00000100:00100000:2.0:1787756370.469168:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787756370.469176:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874598287149696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756370.469261:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874598287149696:12345-0@lo:400:kworker.0 Request processed in 85us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756370.469268:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787756370.469283:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787756370.469288:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874598287149568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756370.469313:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874598287149568:12345-0@lo:400:kworker.0 Request processed in 25us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756370.469318:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787756370.469328:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787756370.469333:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287149824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756370.469358:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287149824:12345-0@lo:400:kworker.0 Request processed in 25us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756370.469363:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787756370.469401:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287149824:0@lo:400:kworker.0 00000100:00100000:2.0:1787756370.469430:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787756370.469438:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287149952:0@lo:400:kworker.0 00000100:00100000:2.0:1787756370.469470:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756370.469509:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874598287149568:0@lo:400:kworker.0 00000100:00100000:2.0:1787756370.469519:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874598287149696:0@lo:400:kworker.0 00000100:00100000:2.0:1787756370.469550:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287149952 00000100:00100000:2.0:1787756370.469554:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287149952 00000100:00100000:2.0:1787756370.469582:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787756370.469589:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287149952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756370.469622:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287149952:12345-0@lo:400:kworker.0 Request processed in 33us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756370.469629:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787756370.469657:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfc683c0 x1874598287149952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756370.469668:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287149952:0@lo:400:kworker.0 00000100:00080000:0.0:1787756370.470040:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787756370.470044:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787756370.476734:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3310:x1874598287149440:12345-0@lo:400:kworker.0 Request processed in 11921us (12137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756370.476750:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787756370.477984:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287149440:0@lo:400:kworker.0 00000100:00100000:0.0:1787756370.976911:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287150080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787756370.977060:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756370.981316:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287150080 00000100:00100000:1.0:1787756370.981331:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287150080 00000100:00100000:1.0:1787756370.981388:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787756370.981397:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287150080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787756370.981434:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787756370.981520:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287150080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (4460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756370.981529:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787756370.981704:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c70000 x1874598287150080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756370.981726:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287150080:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787756371.095939:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756371.881785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756371.881873:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264052608 00000100:00100000:3.0:1787756371.881882:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264052608 00000100:00100000:3.0:1787756371.882056:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 193 00000100:00100000:3.0:1787756371.882067:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2366:x1874598264052608:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787756371.884310:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2366:x1874598264052608:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 2236us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756371.884324:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 193 00000100:00100000:1.0:1787756371.891991:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756371.892024:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756371.892046:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756371.892067:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264052864 00000100:00100000:1.0:1787756371.892075:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264052864 00000100:00100000:3.0:1787756371.892434:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264052736 00000100:00100000:3.0:1787756371.892440:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264052736 00000100:00100000:3.0:1787756371.892478:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:3.0:1787756371.892488:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+6:2366:x1874598264052736:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787756371.892567:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c60f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+6:2366:x1874598264052736:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 80us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756371.892575:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:3.0:1787756371.893366:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264052992 00000100:00100000:3.0:1787756371.893373:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264052992 00000100:00100000:3.0:1787756371.896857:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:3.0:1787756371.896880:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcdd3d25-193d-42cb-911a-069eb2969705+5:2366:x1874598264052864:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787756371.896976:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcdd3d25-193d-42cb-911a-069eb2969705+5:2366:x1874598264052864:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 107us (4950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756371.896985:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:3.0:1787756371.897005:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:3.0:1787756371.897012:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcdd3d25-193d-42cb-911a-069eb2969705+5:2366:x1874598264052992:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787756371.897036:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcdd3d25-193d-42cb-911a-069eb2969705+5:2366:x1874598264052992:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 25us (4990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756371.897042:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00080000:1.0:1787756371.899057:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787756371.899065:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787756371.899067:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787756372.120244:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787756372.837630:0:8821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787756373.146356:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756374.167976:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756375.194292:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756375.576794:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787756375.576816:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287150208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756375.576880:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287150464:0@lo:400:kworker.0 00000100:00100000:2.0:1787756375.576904:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756375.576919:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756375.576995:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae847292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287150720:0@lo:400:kworker.0 00000100:00100000:2.0:1787756375.577141:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae84728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287150592:0@lo:400:kworker.0 00000100:00100000:2.0:1787756375.577477:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756375.577727:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287150336:0@lo:400:kworker.0 00000100:00100000:2.0:1787756375.577757:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756375.577781:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae8472a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287150848:0@lo:400:kworker.0 00000100:00100000:2.0:1787756375.577802:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756375.577830:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287150208 00000100:00100000:2.0:1787756375.577860:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287150208 00000100:00100000:2.0:1787756375.577914:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787756375.577923:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287150208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787756375.577957:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787756375.577998:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287150208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756375.578005:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787756375.578134:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287150464 00000100:00100000:2.0:1787756375.578187:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287150464 00000100:00100000:2.0:1787756375.578446:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287150592 00000100:00100000:2.0:1787756375.578492:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287150592 00000100:00100000:3.0:1787756375.578718:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756375.578763:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287150720 00000100:00100000:3.0:1787756375.578766:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287150720 00000100:00100000:3.0:1787756375.578792:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787756375.578800:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287150720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756375.578851:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287150720:12345-0@lo:400:kworker.0 Request processed in 52us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756375.578857:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787756375.578897:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae847292c0 x1874598287150720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756375.578911:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae847292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287150720:0@lo:400:kworker.0 00000100:00100000:3.0:1787756375.578962:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287150848 00000100:00100000:3.0:1787756375.578966:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287150848 00000100:00100000:3.0:1787756375.578984:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787756375.578991:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae8472b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287150464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756375.579079:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787756375.579087:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287150592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756375.579120:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287150592:12345-0@lo:400:kworker.0 Request processed in 34us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756375.579127:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787756375.579140:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787756375.579146:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287150848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756375.579178:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287150848:12345-0@lo:400:kworker.0 Request processed in 32us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756375.579193:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787756375.579224:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae8472a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287150848:0@lo:400:kworker.0 00000100:00100000:2.0:1787756375.579246:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae84728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287150592:0@lo:400:kworker.0 00010000:00080000:2.0:1787756375.579257:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfc69680 x1874598287150208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756375.579275:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287150208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787756375.579379:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae8472b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287150464:12345-0@lo:400:kworker.0 Request processed in 388us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756375.579386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787756375.579413:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287150336 00000100:00100000:2.0:1787756375.579417:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287150336 00000100:00080000:3.0:1787756375.579492:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787756375.579497:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287150464:0@lo:400:kworker.0 00000100:00080000:3.0:1787756375.579508:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787756375.579528:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae84728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287150976:0@lo:400:kworker.0 00000100:00100000:3.0:1787756375.579591:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756375.579705:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787756375.579714:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3309:x1874598287150336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756375.579749:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3309:x1874598287150336:12345-0@lo:400:kworker.0 Request processed in 36us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756375.579755:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787756375.579786:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287150976 00000100:00100000:1.0:1787756375.579791:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287150976 00000100:00100000:3.0:1787756375.579815:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287150336:0@lo:400:kworker.0 00000100:00100000:1.0:1787756375.579850:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787756375.579858:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287150976:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787756375.579864:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787756375.583118:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287150976:12345-0@lo:400:kworker.0 Request processed in 3253us (3519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756375.583133:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787756375.590983:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae84728780 x1874598287150976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756375.591001:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae84728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287150976:0@lo:400:kworker.0 00000100:00100000:3.0:1787756376.090556:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787756376.090581:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287151104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787756376.090659:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756376.090745:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287151104 00000100:00100000:3.0:1787756376.090753:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287151104 00000100:00100000:3.0:1787756376.090796:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787756376.090805:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287151104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787756376.090864:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787756376.090926:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287151104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756376.090934:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787756376.091252:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c70000 x1874598287151104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756376.091271:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287151104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787756376.216085:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756377.019018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756377.019059:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756377.019087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756377.019114:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264053248 00000100:00100000:1.0:1787756377.019122:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264053248 00000100:00100000:3.0:1787756377.019485:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264053120 00000100:00100000:3.0:1787756377.019526:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264053120 00000100:00100000:3.0:1787756377.019569:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 195 00000100:00100000:3.0:1787756377.019579:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2366:x1874598264053120:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787756377.019660:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2366:x1874598264053120:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 82us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756377.019668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 195 00000100:00100000:3.0:1787756377.019714:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264053376 00000100:00100000:3.0:1787756377.019718:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264053376 00000100:00100000:3.0:1787756377.019747:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:3.0:1787756377.019753:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae84728780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcdd3d25-193d-42cb-911a-069eb2969705+5:2362:x1874598264053376:12345-192.168.203.21@tcp:9:kworker.0 00000020:00000080:3.0:1787756377.019778:0:8483:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x178386880caab0e7 00000100:00080000:3.0:1787756377.019787:0:8483:0:(import.c:65:import_set_state_nolock()) ffff98ae820a7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787756377.019862:0:8483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787756377.020141:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae84728780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bcdd3d25-193d-42cb-911a-069eb2969705+2:2362:x1874598264053376:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 386us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756377.020820:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00080000:3.0:1787756377.020867:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787756377.020873:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787756377.020918:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756377.021099:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264053504 00000100:00100000:3.0:1787756377.021105:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264053504 00000100:00080000:2.0:1787756377.021164:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787756377.021905:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:3.0:1787756377.021918:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcdd3d25-193d-42cb-911a-069eb2969705+5:2362:x1874598264053504:12345-192.168.203.21@tcp:9:kworker.0 00000020:00000080:3.0:1787756377.022021:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x178386880caab0ee 00000100:00080000:3.0:1787756377.022032:0:6690:0:(import.c:65:import_set_state_nolock()) ffff98af8a302800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787756377.022067:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787756377.022638:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756377.022969:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756377.023321:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:1.0:1787756377.023335:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae8472b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:2366:x1874598264053248:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787756377.023401:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae8472b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:2366:x1874598264053248:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 71us (4313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756377.023409:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:3.0:1787756377.024098:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcdd3d25-193d-42cb-911a-069eb2969705+2:2362:x1874598264053504:12345-192.168.203.21@tcp:9:kworker.0 Request processed in 2180us (3177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756377.024108:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00010000:00010000:3.0:1787756377.248043:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756378.264465:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787756378.650070:0:9065:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing yml_node 00010000:00010000:3.0:1787756379.301863:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787756380.295898:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bcdd3d25-193d-42cb-911a-069eb2969705 00000020:00000080:3.0:1787756380.295907:0:6717:0:(genops.c:885:class_export_put()) final put ffff98ae820a6000/bcdd3d25-193d-42cb-911a-069eb2969705 00000020:00000080:0.0:1787756380.299805:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff98ae820a6000/bcdd3d25-193d-42cb-911a-069eb2969705 for lustre-OST0000 00000020:00000080:0.0:1787756380.299898:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98ae820a7000 for lustre-OST0000 00010000:00010000:0.0:1787756380.316122:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756380.696573:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287151232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787756380.696654:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756380.696779:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287151232 00000100:00100000:2.0:1787756380.696788:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287151232 00000100:00100000:2.0:1787756380.696872:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787756380.696882:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287151232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787756380.696919:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787756380.696978:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287151232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756380.697000:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787756380.697971:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787756380.698009:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfc69a40 x1874598287151232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756380.698031:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287151232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787756380.698414:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287151616:0@lo:400:kworker.0 00000100:00100000:0.0:1787756380.698486:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756380.698513:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787756380.698518:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287151744:0@lo:400:kworker.0 00000100:00100000:0.0:1787756380.698539:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756380.698745:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287151360:0@lo:400:kworker.0 00000100:00100000:3.0:1787756380.698776:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756380.698797:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287151872:0@lo:400:kworker.0 00000100:00100000:3.0:1787756380.698820:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756380.698862:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787756380.698867:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287151488:0@lo:400:kworker.0 00000100:00100000:3.0:1787756380.698889:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756380.698919:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287151616 00000100:00100000:3.0:1787756380.698924:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287151616 00000100:00100000:3.0:1787756380.698965:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287151744 00000100:00100000:3.0:1787756380.698968:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287151744 00000100:00100000:3.0:1787756380.698982:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287151488 00000100:00100000:3.0:1787756380.698986:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287151488 00000100:00100000:3.0:1787756380.698999:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787756380.699008:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287151616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756380.699067:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287151616:12345-0@lo:400:kworker.0 Request processed in 60us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756380.699074:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787756380.699092:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787756380.699099:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287151744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756380.699126:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287151744:12345-0@lo:400:kworker.0 Request processed in 29us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756380.699133:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787756380.699155:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787756380.699162:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287151488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756380.699189:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287151488:12345-0@lo:400:kworker.0 Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756380.699203:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787756380.699223:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287151872 00000100:00100000:3.0:1787756380.699226:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287151872 00000100:00100000:3.0:1787756380.699246:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787756380.699251:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287151872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756380.699278:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287151872:12345-0@lo:400:kworker.0 Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756380.699284:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787756380.699303:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787756380.699307:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787756380.699326:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287151488:0@lo:400:kworker.0 00010000:00080000:3.0:1787756380.699337:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba4b40 x1874598287151872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756380.699347:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287151872:0@lo:400:kworker.0 00000100:00100000:3.0:1787756380.699377:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287151744:0@lo:400:kworker.0 00000100:00100000:3.0:1787756380.699386:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287151616:0@lo:400:kworker.0 00000100:00100000:2.0:1787756380.699903:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287151360 00000100:00100000:2.0:1787756380.699908:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287151360 00000100:00100000:2.0:1787756380.699947:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787756380.699954:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3309:x1874598287151360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756380.700002:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3309:x1874598287151360:12345-0@lo:400:kworker.0 Request processed in 49us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756380.700009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787756380.700152:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287151360:0@lo:400:kworker.0 00000100:00100000:1.0:1787756381.208365:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787756381.208392:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae84728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287152000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787756381.208487:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756381.209146:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287152000 00000100:00100000:2.0:1787756381.209155:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287152000 00000100:00100000:2.0:1787756381.209204:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787756381.209214:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae84729680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287152000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787756381.209248:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787756381.209300:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae84729680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287152000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756381.209307:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787756381.209885:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae84728b40 x1874598287152000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756381.209905:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae84728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287152000:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787756381.277748:0:7654:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bcdd3d25-193d-42cb-911a-069eb2969705 00000020:00000080:2.0:1787756381.277757:0:7654:0:(genops.c:885:class_export_put()) final put ffff98af8a302000/bcdd3d25-193d-42cb-911a-069eb2969705 00000020:00000080:1.0:1787756381.277885:0:472:0:(genops.c:844:class_export_destroy()) destroying export ffff98af8a302000/bcdd3d25-193d-42cb-911a-069eb2969705 for lustre-OST0001 00000020:00000080:1.0:1787756381.277931:0:472:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff98af8a302800 for lustre-OST0001 00010000:00010000:3.0:1787756381.341646:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756382.122509:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756382.122565:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756382.122651:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264053632 00000100:00100000:2.0:1787756382.122661:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264053632 00000100:00100000:2.0:1787756382.122734:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 197 00000100:00100000:2.0:1787756382.122744:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:2365:x1874598264053632:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787756382.122811:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:2365:x1874598264053632:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 69us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756382.122818:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 197 00000100:00100000:0.0:1787756382.122979:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264053760 00000100:00100000:0.0:1787756382.122984:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264053760 00000100:00100000:0.0:1787756382.123034:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:0.0:1787756382.123041:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+6:2365:x1874598264053760:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787756382.123074:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+6:2365:x1874598264053760:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 34us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756382.123080:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00080000:2.0:1787756382.123449:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787756382.360353:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756383.384179:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787756384.086612:0:9257:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.109 00010000:00010000:0.0:1787756384.408046:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756385.432226:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756385.817825:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287152128:0@lo:400:kworker.0 00000100:00100000:3.0:1787756385.817920:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756385.818610:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287152384:0@lo:400:kworker.0 00000100:00100000:2.0:1787756385.818655:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287152512:0@lo:400:kworker.0 00000100:00100000:3.0:1787756385.818664:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756385.818686:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287152128 00000100:00100000:0.0:1787756385.818696:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287152128 00000100:00100000:2.0:1787756385.818699:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756385.818709:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287152896:0@lo:400:kworker.0 00000100:00100000:2.0:1787756385.818744:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287152384 00000100:00100000:3.0:1787756385.818746:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756385.818755:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787756385.818766:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3311:x1874598287152128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756385.818785:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287152896 00000100:00100000:3.0:1787756385.818790:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287152896 00000100:00100000:0.0:1787756385.818823:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3311:x1874598287152128:12345-0@lo:400:kworker.0 Request processed in 59us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756385.818855:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787756385.818859:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787756385.818867:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287152896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756385.818869:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287152384 00000100:00100000:0.0:1787756385.818902:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae84729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287152256:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787756385.818909:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287152512 00000100:00100000:2.0:1787756385.818914:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287152512 00000100:00100000:3.0:1787756385.818927:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287152896:12345-0@lo:400:kworker.0 Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756385.818943:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787756385.818944:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756385.818952:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787756385.818974:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287152768:0@lo:400:kworker.0 00000100:00100000:3.0:1787756385.818985:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287152640:0@lo:400:kworker.0 00000100:00100000:0.0:1787756385.818999:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756385.819018:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756385.819049:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287152128:0@lo:400:kworker.0 00000100:00100000:0.0:1787756385.819066:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287152768 00000100:00100000:0.0:1787756385.819071:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287152768 00000100:00100000:2.0:1787756385.819089:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287152384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756385.819094:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287152640 00000100:00100000:3.0:1787756385.819099:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287152640 00000100:00100000:0.0:1787756385.819103:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787756385.819122:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287152512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756385.819136:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287152384:12345-0@lo:400:kworker.0 Request processed in 50us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756385.819136:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787756385.819148:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787756385.819161:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287152640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756385.819172:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787756385.819174:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287152512:12345-0@lo:400:kworker.0 Request processed in 61us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756385.819185:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787756385.819185:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287152768:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787756385.819216:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787756385.819222:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787756385.819223:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287152640:12345-0@lo:400:kworker.0 Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00080000:0.0:1787756385.819226:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787756385.819234:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787756385.819242:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287152768:12345-0@lo:400:kworker.0 Request processed in 60us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756385.819250:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787756385.819272:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287152768:0@lo:400:kworker.0 00010000:00080000:3.0:1787756385.819276:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfc692c0 x1874598287152896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756385.819292:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287152512:0@lo:400:kworker.0 00000100:00100000:0.0:1787756385.819304:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287152256 00000100:00100000:0.0:1787756385.819308:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287152256 00010000:00080000:2.0:1787756385.819336:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfc6a1c0 x1874598287152640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756385.819343:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787756385.819355:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287152256:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787756385.819356:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc6a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287152640:0@lo:400:kworker.0 00002000:00000024:0.0:1787756385.819389:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756385.819424:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287152256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756385.819442:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787756385.819449:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287152896:0@lo:400:kworker.0 00000100:00100000:3.0:1787756385.819468:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287152384:0@lo:400:kworker.0 00010000:00080000:2.0:1787756385.819628:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae84729a40 x1874598287152256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756385.819644:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae84729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287152256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787756386.333115:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787756386.333137:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287153024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787756386.333199:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756386.333803:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287153024 00000100:00100000:0.0:1787756386.333810:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287153024 00000100:00100000:0.0:1787756386.333899:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787756386.333909:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287153024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787756386.333945:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756386.334001:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287153024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756386.334008:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787756386.334043:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c7bc00 x1874598287153024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756386.334060:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287153024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787756386.468002:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787756386.776472:0:9355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.109 00000100:00100000:1.0:1787756387.258343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756387.258379:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756387.258459:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264054016 00000100:00100000:0.0:1787756387.258469:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264054016 00000100:00100000:0.0:1787756387.258540:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00100000:0.0:1787756387.258549:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae847283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2363:x1874598264054016:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787756387.258619:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae847283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2363:x1874598264054016:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756387.258627:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 41 00000100:00080000:1.0:1787756387.258806:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787756387.259624:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264053888 00000100:00100000:3.0:1787756387.259632:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264053888 00000100:00100000:3.0:1787756387.259691:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 199 00000100:00100000:3.0:1787756387.259700:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264053888:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787756387.259741:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264053888:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 43us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756387.259749:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 199 00010000:00010000:3.0:1787756387.480010:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756388.508406:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756389.534421:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787756389.669180:0:9453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.109 00010000:00010000:0.0:1787756390.553778:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756390.936189:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287153152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787756390.936220:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287153280:0@lo:400:kworker.0 00000100:00100000:0.0:1787756390.936251:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287153408:0@lo:400:kworker.0 00000100:00100000:3.0:1787756390.936267:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756390.936308:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756390.947647:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756390.947685:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287153664:0@lo:400:kworker.0 00000100:00100000:3.0:1787756390.947743:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756390.947869:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287153664 00000100:00100000:3.0:1787756390.947876:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287153664 00000100:00100000:3.0:1787756390.947930:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787756390.947939:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287153664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756390.947984:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287153664:12345-0@lo:400:kworker.0 Request processed in 46us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756390.947991:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787756390.948014:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287153152 00000100:00100000:3.0:1787756390.948018:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287153152 00000100:00100000:3.0:1787756390.948050:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787756390.948056:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287153152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787756390.948082:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787756390.948110:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287153152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (11846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756390.948115:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787756390.948130:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787756390.948166:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba5680 x1874598287153664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756390.948180:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287153664:0@lo:400:kworker.0 00010000:00080000:3.0:1787756390.948189:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c79a40 x1874598287153152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756390.948202:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287153152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787756390.948224:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787756390.948230:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287153792:0@lo:400:kworker.0 00000100:00100000:3.0:1787756390.948253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756390.948273:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287153408 00000100:00100000:3.0:1787756390.948277:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287153408 00000100:00100000:3.0:1787756390.948300:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287153792 00000100:00100000:3.0:1787756390.948303:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287153792 00000100:00100000:3.0:1787756390.948325:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787756390.948332:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bf52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287153408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756390.948369:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bf52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287153408:12345-0@lo:400:kworker.0 Request processed in 37us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756390.948375:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287153280 00000100:00100000:3.0:1787756390.948378:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787756390.948382:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287153280 00000100:00100000:3.0:1787756390.948410:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787756390.948425:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287153792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756390.948430:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787756390.948440:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287153280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756390.948458:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287153792:12345-0@lo:400:kworker.0 Request processed in 35us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756390.948465:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787756390.948483:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787756390.948487:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287153280:12345-0@lo:400:kworker.0 Request processed in 49us (12200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756390.948495:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787756390.948501:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287153792:0@lo:400:kworker.0 00000100:00100000:3.0:1787756390.948573:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287153280:0@lo:400:kworker.0 00000100:00100000:3.0:1787756390.948611:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287153536:0@lo:400:kworker.0 00000100:00100000:3.0:1787756390.948639:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756390.948663:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287153536 00000100:00100000:3.0:1787756390.948666:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287153536 00000100:00100000:3.0:1787756390.948969:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787756390.948977:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287153536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756390.949012:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287153536:12345-0@lo:400:kworker.0 Request processed in 37us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756390.949018:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787756390.949032:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787756390.949046:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287153536:0@lo:400:kworker.0 00000100:00100000:0.0:1787756390.949879:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287153408:0@lo:400:kworker.0 00000100:00100000:0.0:1787756390.949888:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98af99bf4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287153920:0@lo:400:kworker.0 00000100:00100000:0.0:1787756390.949920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756390.950105:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287153920 00000100:00100000:3.0:1787756390.950110:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287153920 00000100:00100000:3.0:1787756390.950154:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787756390.950162:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89913c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287153920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756390.950202:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89913c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287153920:12345-0@lo:400:kworker.0 Request processed in 40us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756390.950207:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787756390.950494:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787756390.950520:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98af99bf4780 x1874598287153920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756390.950530:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98af99bf4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287153920:0@lo:400:kworker.0 00000100:00100000:0.0:1787756391.448956:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787756391.448994:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287154048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787756391.449179:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756391.449341:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287154048 00000100:00100000:3.0:1787756391.449348:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287154048 00000100:00100000:3.0:1787756391.449402:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787756391.449411:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89910f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287154048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787756391.449442:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787756391.449486:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89910f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287154048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756391.449493:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787756391.450610:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c79a40 x1874598287154048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756391.450634:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287154048:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787756391.576038:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787756391.793213:0:9502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-compr ============----- Wed Aug 26 10:59:50 EDT 2026 00000100:00100000:3.0:1787756392.367694:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756392.367743:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756392.367858:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264054272 00000100:00100000:1.0:1787756392.367867:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264054272 00000100:00100000:0.0:1787756392.367927:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264054144 00000100:00100000:0.0:1787756392.367932:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264054144 00000100:00100000:0.0:1787756392.367981:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 201 00000100:00100000:0.0:1787756392.367992:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264054144:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787756392.368050:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 45 00000100:00100000:0.0:1787756392.368059:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264054144:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 69us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756392.368059:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2363:x1874598264054272:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787756392.368067:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 201 00000100:00080000:3.0:1787756392.368256:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787756392.368635:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2363:x1874598264054272:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 576us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756392.368754:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 45 00010000:00010000:0.0:1787756392.602173:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756393.634724:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756394.648625:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756395.677918:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756396.056560:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287154560:0@lo:400:kworker.0 00000100:00100000:3.0:1787756396.056630:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756396.056694:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787756396.056701:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287154432:0@lo:400:kworker.0 00000100:00100000:3.0:1787756396.056727:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756396.056757:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287154560 00000100:00100000:3.0:1787756396.056763:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287154560 00000100:00100000:3.0:1787756396.056817:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787756396.056826:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287154560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756396.056895:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287154560:12345-0@lo:400:kworker.0 Request processed in 69us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756396.056902:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787756396.056927:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287154432 00000100:00100000:3.0:1787756396.056931:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287154432 00000100:00100000:3.0:1787756396.056974:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787756396.056993:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287154432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756396.057023:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287154432:12345-0@lo:400:kworker.0 Request processed in 43us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756396.057028:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787756396.057059:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787756396.057063:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787756396.057092:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287154432:0@lo:400:kworker.0 00010000:00080000:3.0:1787756396.057105:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba5e00 x1874598287154560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756396.057113:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287154560:0@lo:400:kworker.0 00000100:00100000:0.0:1787756396.057487:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874598287154304:0@lo:400:kworker.0 00000100:00100000:0.0:1787756396.057623:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756396.057657:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287154816:0@lo:400:kworker.0 00000100:00100000:0.0:1787756396.057680:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756396.057710:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787756396.057716:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287154176:0@lo:400:kworker.0 00000100:00100000:0.0:1787756396.057742:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756396.057776:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287154688:0@lo:400:kworker.0 00000100:00100000:0.0:1787756396.057800:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756396.058972:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287154304 00000100:00100000:1.0:1787756396.059084:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287154304 00000100:00100000:1.0:1787756396.059123:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287154688 00000100:00100000:1.0:1787756396.059127:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287154688 00000100:00100000:1.0:1787756396.059153:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787756396.059161:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89913840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874598287154304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756396.059287:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287154816 00000100:00100000:0.0:1787756396.059293:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287154816 00000100:00100000:0.0:1787756396.059323:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787756396.059330:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af89911a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287154816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756396.059389:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89911a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287154816:12345-0@lo:400:kworker.0 Request processed in 60us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756396.059397:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787756396.059426:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae8472bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287154944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787756396.059458:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756396.059491:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287154944 00000100:00100000:0.0:1787756396.059495:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287154944 00000100:00100000:0.0:1787756396.059519:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787756396.059656:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af89913840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874598287154304:12345-0@lo:400:kworker.0 Request processed in 494us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756396.059663:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787756396.059677:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787756396.059684:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af899121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287154688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756396.059714:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af899121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287154688:12345-0@lo:400:kworker.0 Request processed in 30us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756396.059719:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787756396.059740:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287154176 00000100:00100000:1.0:1787756396.059955:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287154176 00000100:00080000:3.0:1787756396.060244:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787756396.060249:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787756396.060358:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af899130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287154944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787756396.060398:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756396.060448:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af899130c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287154944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 923us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756396.060455:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787756396.060509:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287154688:0@lo:400:kworker.0 00000100:00100000:0.0:1787756396.060521:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874598287154304:0@lo:400:kworker.0 00010000:00080000:0.0:1787756396.060551:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba5680 x1874598287154816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756396.060561:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287154816:0@lo:400:kworker.0 00000100:00100000:1.0:1787756396.060677:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787756396.060685:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287154176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756396.060728:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287154176:12345-0@lo:400:kworker.0 Request processed in 44us (2985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756396.060756:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00080000:3.0:1787756396.060825:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae8472bc00 x1874598287154944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756396.060859:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae8472bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287154944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787756396.061199:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287154176:0@lo:400:kworker.0 00000100:00100000:3.0:1787756396.569285:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787756396.569306:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287155072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787756396.569379:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756396.569537:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287155072 00000100:00100000:1.0:1787756396.569544:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287155072 00000100:00100000:1.0:1787756396.569594:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787756396.569601:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287155072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787756396.569632:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787756396.569675:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287155072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756396.569681:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787756396.569725:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba5680 x1874598287155072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756396.569740:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287155072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787756396.702492:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756397.486671:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756397.486721:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756397.486764:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264054400 00000100:00100000:3.0:1787756397.486773:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264054400 00000100:00100000:3.0:1787756397.486820:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 203 00000100:00100000:3.0:1787756397.486830:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:2365:x1874598264054400:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787756397.486922:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:2365:x1874598264054400:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756397.486930:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 203 00000100:00100000:0.0:1787756397.491467:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264054528 00000100:00100000:0.0:1787756397.491482:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264054528 00000100:00100000:0.0:1787756397.491568:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 49 00000100:00100000:0.0:1787756397.491578:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2365:x1874598264054528:12345-192.168.203.21@tcp:400:kworker.0 00000100:00080000:3.0:1787756397.491604:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787756397.491669:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2365:x1874598264054528:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 92us (5005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756397.491677:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 49 00010000:00010000:3.0:1787756397.726813:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756398.743952:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756399.768216:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756400.798022:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756401.180114:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874598287155328:0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.180178:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756401.180238:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287155840:0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.180265:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756401.180298:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787756401.180304:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287155200:0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.180342:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756401.180360:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287155712:0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.180380:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756401.180401:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287155584:0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.180422:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756401.180436:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787756401.180440:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287155456:0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.180457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756401.180479:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287155328 00000100:00100000:0.0:1787756401.180485:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287155328 00000100:00100000:0.0:1787756401.180522:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287155712 00000100:00100000:0.0:1787756401.180530:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287155712 00000100:00100000:0.0:1787756401.180551:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287155456 00000100:00100000:0.0:1787756401.180553:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287155456 00000100:00100000:0.0:1787756401.180567:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787756401.180574:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874598287155328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.180624:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874598287155328:12345-0@lo:400:kworker.0 Request processed in 49us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756401.180631:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787756401.180646:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787756401.180652:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287155712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.180675:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287155712:12345-0@lo:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756401.180680:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787756401.180689:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787756401.180695:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287155456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.180722:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287155456:12345-0@lo:400:kworker.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756401.180728:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787756401.180762:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287155456:0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.180789:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287155712:0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.180798:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874598287155328:0@lo:400:kworker.0 00000100:00100000:1.0:1787756401.180918:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae8472b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287155968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756401.180947:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756401.180976:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287155200 00000100:00100000:1.0:1787756401.180980:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287155200 00000100:00100000:1.0:1787756401.181003:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787756401.181009:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287155200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756401.181041:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287155200:12345-0@lo:400:kworker.0 Request processed in 32us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756401.181047:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787756401.181072:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287155968 00000100:00100000:1.0:1787756401.181076:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287155968 00000100:00100000:1.0:1787756401.181099:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787756401.181105:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae8472a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287155968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787756401.181136:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787756401.181171:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae8472a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287155968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756401.181178:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787756401.181203:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae8472b480 x1874598287155968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756401.181219:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae8472b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287155968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756401.181240:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa71680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287155200:0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.182793:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287155840 00000100:00100000:0.0:1787756401.182804:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287155840 00000100:00100000:0.0:1787756401.182885:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287155584 00000100:00100000:0.0:1787756401.182889:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287155584 00000100:00100000:0.0:1787756401.182908:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787756401.182928:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287155840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.182998:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287155840:12345-0@lo:400:kworker.0 Request processed in 72us (2732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756401.183004:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787756401.183018:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787756401.183024:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287155584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.183053:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287155584:12345-0@lo:400:kworker.0 Request processed in 29us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756401.183058:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787756401.183095:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfa703c0 x1874598287155584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756401.183109:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa703c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287155584:0@lo:400:kworker.0 00000100:00080000:0.0:1787756401.183139:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787756401.183143:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787756401.183146:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787756401.187608:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfa73c00 x1874598287155840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756401.187626:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287155840:0@lo:400:kworker.0 00000100:00100000:0.0:1787756401.697879:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287156096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787756401.697955:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756401.701530:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287156096 00000100:00100000:0.0:1787756401.701545:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287156096 00000100:00100000:0.0:1787756401.701603:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787756401.701612:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287156096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787756401.701673:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756401.701750:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287156096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (3794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756401.701756:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787756401.701794:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba4780 x1874598287156096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756401.701824:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287156096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787756401.818584:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756402.602373:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756402.602434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756402.602576:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264054656 00000100:00100000:2.0:1787756402.602585:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264054656 00000100:00100000:2.0:1787756402.602643:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 205 00000100:00100000:2.0:1787756402.602653:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264054656:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787756402.602717:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86929850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264054656:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 65us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756402.602724:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 205 00000100:00100000:1.0:1787756402.604269:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264054784 00000100:00100000:1.0:1787756402.604278:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264054784 00000100:00100000:1.0:1787756402.604354:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00100000:1.0:1787756402.604364:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264054784:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787756402.604420:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264054784:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 57us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756402.604427:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 53 00000100:00080000:3.0:1787756402.605644:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787756402.840041:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756403.867757:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756404.889345:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756405.911968:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756406.297002:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287156480:0@lo:400:kworker.0 00000100:00100000:0.0:1787756406.297069:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756406.297137:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787756406.297142:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287156608:0@lo:400:kworker.0 00000100:00100000:0.0:1787756406.297174:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756406.297208:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287156480 00000100:00100000:0.0:1787756406.297215:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287156480 00000100:00100000:0.0:1787756406.297263:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787756406.297271:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287156480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756406.297327:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287156480:12345-0@lo:400:kworker.0 Request processed in 56us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756406.297334:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787756406.297353:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287156608 00000100:00100000:0.0:1787756406.297356:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287156608 00000100:00100000:0.0:1787756406.297377:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787756406.297382:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287156608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756406.297408:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287156608:12345-0@lo:400:kworker.0 Request processed in 26us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756406.297414:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787756406.297426:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787756406.297429:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787756406.297456:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfa730c0 x1874598287156608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756406.297482:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287156608:0@lo:400:kworker.0 00000100:00100000:0.0:1787756406.297492:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287156480:0@lo:400:kworker.0 00000100:00100000:1.0:1787756406.298157:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874598287156352:0@lo:400:kworker.0 00000100:00100000:1.0:1787756406.298369:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756406.298392:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287156864:0@lo:400:kworker.0 00000100:00100000:1.0:1787756406.298420:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756406.298450:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787756406.298456:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287156224:0@lo:400:kworker.0 00000100:00100000:1.0:1787756406.298479:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756406.298496:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287156736:0@lo:400:kworker.0 00000100:00100000:1.0:1787756406.298512:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756406.298586:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287156352 00000100:00100000:1.0:1787756406.298590:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287156352 00000100:00100000:1.0:1787756406.298615:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287156736 00000100:00100000:1.0:1787756406.298617:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287156736 00000100:00100000:1.0:1787756406.298637:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787756406.298643:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae84728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874598287156352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756406.298678:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae84728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874598287156352:12345-0@lo:400:kworker.0 Request processed in 34us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756406.298684:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787756406.298695:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787756406.298700:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae8472a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287156736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756406.298827:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae8472a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287156736:12345-0@lo:400:kworker.0 Request processed in 20us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756406.298853:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787756406.298869:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287156864 00000100:00100000:1.0:1787756406.298872:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287156864 00000100:00100000:1.0:1787756406.298892:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787756406.298897:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae8472bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287156864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756406.298923:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae8472bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287156864:12345-0@lo:400:kworker.0 Request processed in 26us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756406.298929:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787756406.299067:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287156224 00000100:00100000:1.0:1787756406.299070:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287156224 00000100:00100000:1.0:1787756406.299804:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787756406.299816:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287156224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756406.299878:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287156224:12345-0@lo:400:kworker.0 Request processed in 66us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756406.299885:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787756406.302374:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787756406.302395:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287156992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787756406.302452:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756406.302496:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287156992 00000100:00100000:0.0:1787756406.302501:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287156992 00000100:00100000:0.0:1787756406.302547:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787756406.302555:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287156992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787756406.302592:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756406.302634:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287156992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756406.302641:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787756406.302684:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfa70780 x1874598287156992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756406.302704:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287156992:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787756406.304313:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787756406.304324:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787756406.306198:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287156224:0@lo:400:kworker.0 00000100:00100000:0.0:1787756406.306220:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287156736:0@lo:400:kworker.0 00000100:00100000:0.0:1787756406.306232:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874598287156352:0@lo:400:kworker.0 00010000:00080000:0.0:1787756406.306245:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfa70b40 x1874598287156864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756406.306270:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287156864:0@lo:400:kworker.0 00000100:00100000:2.0:1787756406.811295:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787756406.811318:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287157120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787756406.811397:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756406.811858:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287157120 00000100:00100000:0.0:1787756406.811865:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287157120 00000100:00100000:0.0:1787756406.811913:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787756406.811922:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287157120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787756406.811955:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756406.812006:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287157120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756406.812013:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787756406.812413:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae81ba5680 x1874598287157120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756406.812431:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae81ba5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287157120:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787756406.938582:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756407.728149:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756407.728185:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264055040 00000100:00100000:3.0:1787756407.728194:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264055040 00000100:00100000:3.0:1787756407.728260:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00100000:3.0:1787756407.728271:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264055040:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787756407.728353:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264055040:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 83us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756407.728361:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 57 00000100:00080000:0.0:1787756407.728885:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787756407.742935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756407.743021:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264054912 00000100:00100000:2.0:1787756407.743032:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264054912 00000100:00100000:2.0:1787756407.743079:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 207 00000100:00100000:2.0:1787756407.743089:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264054912:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787756407.743162:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264054912:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 74us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756407.743181:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 207 00000001:02000400:0.0:1787756407.927701:0:10230:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 1081 00010000:00010000:1.0:1787756407.963529:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756408.984131:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787756409.399047:0:10278:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: start setup 11:00:08 (1787756408) === 00010000:00010000:1.0:1787756410.008043:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756411.035773:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756411.416450:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787756411.416475:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287157248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756411.416547:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756411.417826:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287157248 00000100:00100000:0.0:1787756411.417868:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287157248 00000100:00100000:0.0:1787756411.417936:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787756411.417947:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae84728b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287157248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787756411.417982:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756411.418045:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae84728b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287157248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756411.418052:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787756411.418654:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787756411.418690:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfa72940 x1874598287157248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756411.418713:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287157248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756411.418866:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287157376:0@lo:400:kworker.0 00000100:00100000:1.0:1787756411.418905:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756411.419044:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287157504:0@lo:400:kworker.0 00000100:00100000:3.0:1787756411.419086:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756411.419106:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787756411.419111:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287157632:0@lo:400:kworker.0 00000100:00100000:3.0:1787756411.419141:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756411.419170:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287157504 00000100:00100000:3.0:1787756411.419174:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287157504 00000100:00100000:3.0:1787756411.419241:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287157632 00000100:00100000:3.0:1787756411.419244:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287157632 00000100:00100000:3.0:1787756411.419283:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787756411.419290:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287157504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756411.419331:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287157504:12345-0@lo:400:kworker.0 Request processed in 41us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756411.419338:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787756411.419352:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787756411.419358:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb360bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287157632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756411.419380:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb360bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287157632:12345-0@lo:400:kworker.0 Request processed in 23us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756411.419386:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787756411.419410:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287157760:0@lo:400:kworker.0 00000100:00100000:3.0:1787756411.419433:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787756411.419456:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787756411.419474:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287157632:0@lo:400:kworker.0 00000100:00100000:3.0:1787756411.419483:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287157504:0@lo:400:kworker.0 00000100:00100000:3.0:1787756411.419499:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287157760 00000100:00100000:3.0:1787756411.419502:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287157760 00000100:00100000:3.0:1787756411.419526:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787756411.419539:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287157760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756411.419571:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287157760:12345-0@lo:400:kworker.0 Request processed in 33us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756411.419577:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787756411.419591:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787756411.419617:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287157760:0@lo:400:kworker.0 00000100:00100000:0.0:1787756411.419691:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287157376 00000100:00100000:0.0:1787756411.419696:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287157376 00000100:00100000:0.0:1787756411.419730:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787756411.419737:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287157376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756411.424447:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787756411.424465:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287157888:0@lo:400:kworker.0 00000100:00100000:2.0:1787756411.424531:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756411.424575:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287157888 00000100:00100000:2.0:1787756411.424581:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287157888 00000100:00100000:2.0:1787756411.424635:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787756411.424645:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287157888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756411.424695:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc68b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287157888:12345-0@lo:400:kworker.0 Request processed in 52us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756411.424703:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787756411.424723:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787756411.424750:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfc683c0 x1874598287157888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756411.424763:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287157888:0@lo:400:kworker.0 00000100:00100000:0.0:1787756411.430297:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287157376:12345-0@lo:400:kworker.0 Request processed in 10551us (11381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756411.430322:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787756411.433382:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287157376:0@lo:400:kworker.0 00000100:00100000:3.0:1787756411.928782:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb360ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287158016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787756411.928882:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756411.929198:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287158016 00000100:00100000:3.0:1787756411.929205:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287158016 00000100:00100000:3.0:1787756411.929244:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787756411.929266:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3609e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287158016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787756411.929299:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787756411.931633:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3609e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287158016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756411.931647:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787756411.931737:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb360ad00 x1874598287158016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756411.931757:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb360ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287158016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787756412.057125:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756412.849913:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756412.849962:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756412.850040:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264055168 00000100:00100000:1.0:1787756412.850049:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264055168 00000100:00100000:0.0:1787756412.850092:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264055296 00000100:00100000:0.0:1787756412.850097:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264055296 00000100:00100000:1.0:1787756412.850104:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 209 00000100:00100000:1.0:1787756412.850112:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2365:x1874598264055168:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787756412.850135:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00100000:0.0:1787756412.850142:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb360ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2365:x1874598264055296:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787756412.850175:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb360ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2365:x1874598264055296:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 34us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756412.850184:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 61 00000100:00080000:0.0:1787756412.850202:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787756412.852027:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86928850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2365:x1874598264055168:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 1907us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756412.852047:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 209 00010000:00010000:0.0:1787756413.096523:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756414.104765:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756415.128029:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787756415.225141:0:10471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787756416.163608:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756416.535965:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287158144:0@lo:400:kworker.0 00000100:00100000:2.0:1787756416.535996:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287158272:0@lo:400:kworker.0 00000100:00100000:2.0:1787756416.536058:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756416.536105:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287158784:0@lo:400:kworker.0 00000100:00100000:2.0:1787756416.536132:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756416.536175:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787756416.536182:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287158400:0@lo:400:kworker.0 00000100:00100000:2.0:1787756416.536201:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756416.536201:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756416.536240:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874598287158656:0@lo:400:kworker.0 00000100:00100000:2.0:1787756416.536245:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287158272 00000100:00100000:2.0:1787756416.536251:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287158272 00000100:00100000:3.0:1787756416.536273:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756416.536290:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287158400 00000100:00100000:3.0:1787756416.536290:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787756416.536295:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287158528:0@lo:400:kworker.0 00000100:00100000:2.0:1787756416.536298:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287158400 00000100:00100000:3.0:1787756416.536315:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756416.536322:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287158656 00000100:00100000:2.0:1787756416.536325:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287158656 00000100:00100000:3.0:1787756416.536341:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287158144 00000100:00100000:2.0:1787756416.536342:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787756416.536344:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287158144 00000100:00100000:2.0:1787756416.536349:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287158272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756416.536366:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787756416.536372:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8692a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3310:x1874598287158144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756416.536398:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287158272:12345-0@lo:400:kworker.0 Request processed in 48us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756416.536398:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8692a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3310:x1874598287158144:12345-0@lo:400:kworker.0 Request processed in 25us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756416.536406:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787756416.536406:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787756416.536421:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787756416.536427:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287158400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756416.536434:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787756416.536439:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb360a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874598287158656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756416.536452:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287158400:12345-0@lo:400:kworker.0 Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756416.536458:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787756416.536460:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb360a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874598287158656:12345-0@lo:400:kworker.0 Request processed in 22us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756416.536465:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787756416.536474:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287158784 00000100:00100000:2.0:1787756416.536477:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287158784 00000100:00100000:2.0:1787756416.536499:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287158528 00000100:00100000:2.0:1787756416.536502:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287158528 00000100:00100000:2.0:1787756416.536519:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787756416.536525:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af99bf4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287158784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756416.536555:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af99bf4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287158784:12345-0@lo:400:kworker.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756416.536558:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787756416.536562:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787756416.536565:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3608f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287158528:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787756416.536582:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787756416.536586:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787756416.536588:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787756416.536593:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3608f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287158528:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756416.536599:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787756416.536617:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287158400:0@lo:400:kworker.0 00010000:00080000:3.0:1787756416.536623:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfc69680 x1874598287158528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756416.536627:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287158272:0@lo:400:kworker.0 00000100:00100000:3.0:1787756416.536633:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287158528:0@lo:400:kworker.0 00000100:00100000:3.0:1787756416.536642:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1874598287158656:0@lo:400:kworker.0 00010000:00080000:2.0:1787756416.536645:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfc68780 x1874598287158784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756416.536653:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287158784:0@lo:400:kworker.0 00000100:00100000:3.0:1787756416.536655:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287158144:0@lo:400:kworker.0 00000100:00100000:0.0:1787756416.537078:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787756416.537087:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287158912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787756416.537120:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756416.537240:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287158912 00000100:00100000:2.0:1787756416.537245:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287158912 00000100:00100000:2.0:1787756416.537272:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787756416.537278:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287158912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787756416.537305:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787756416.537352:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287158912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756416.537358:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787756416.541414:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca2d00 x1874598287158912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756416.541442:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287158912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787756417.049402:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287159040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787756417.049484:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756417.057689:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287159040 00000100:00100000:2.0:1787756417.057707:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287159040 00000100:00100000:2.0:1787756417.057796:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787756417.057808:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287159040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787756417.057873:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787756417.057962:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287159040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (8477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756417.057969:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787756417.058028:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfa73c00 x1874598287159040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756417.058047:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287159040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787756417.177790:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756417.968540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756417.968576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756417.968726:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264055424 00000100:00100000:1.0:1787756417.968735:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264055424 00000100:00100000:1.0:1787756417.968799:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 211 00000100:00100000:1.0:1787756417.968807:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2366:x1874598264055424:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787756417.968899:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2366:x1874598264055424:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 91us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756417.968906:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 211 00000100:00100000:2.0:1787756417.969941:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264055552 00000100:00100000:2.0:1787756417.969948:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264055552 00000100:00100000:2.0:1787756417.970013:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00100000:2.0:1787756417.970037:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+6:2366:x1874598264055552:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787756417.970108:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+6:2366:x1874598264055552:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 74us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756417.970115:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 65 00000100:00080000:0.0:1787756417.970400:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787756418.201037:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756419.226360:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756420.248044:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756421.272353:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756421.656117:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae847292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287159296:0@lo:400:kworker.0 00000100:00100000:1.0:1787756421.656198:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756421.656258:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae84729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287159808:0@lo:400:kworker.0 00000100:00100000:1.0:1787756421.656307:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756421.656340:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787756421.656345:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae84728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287159424:0@lo:400:kworker.0 00000100:00100000:1.0:1787756421.656381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756421.656416:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287159296 00000100:00100000:1.0:1787756421.656423:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287159296 00000100:00100000:1.0:1787756421.656477:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287159424 00000100:00100000:1.0:1787756421.656488:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287159424 00000100:00100000:1.0:1787756421.656522:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787756421.656530:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae8472b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287159296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756421.656580:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae8472b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287159296:12345-0@lo:400:kworker.0 Request processed in 51us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756421.656586:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787756421.656601:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787756421.656607:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287159424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756421.656633:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287159424:12345-0@lo:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756421.656638:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787756421.656655:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287159808 00000100:00100000:1.0:1787756421.656658:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287159808 00000100:00100000:1.0:1787756421.656684:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787756421.656691:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287159808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756421.656720:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287159808:12345-0@lo:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756421.656726:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787756421.656746:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787756421.656750:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787756421.656781:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae84728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287159424:0@lo:400:kworker.0 00000100:00100000:1.0:1787756421.656792:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae847292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287159296:0@lo:400:kworker.0 00010000:00080000:1.0:1787756421.656803:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae84729e00 x1874598287159808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756421.656813:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae84729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287159808:0@lo:400:kworker.0 00000100:00100000:3.0:1787756421.657090:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae84729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287159552:0@lo:400:kworker.0 00000100:00100000:3.0:1787756421.657121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756421.657142:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787756421.657147:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae8472a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287159168:0@lo:400:kworker.0 00000100:00100000:3.0:1787756421.657172:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756421.657208:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98ae8472ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287159680:0@lo:400:kworker.0 00000100:00100000:3.0:1787756421.657227:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756421.657250:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287159552 00000100:00100000:3.0:1787756421.657253:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287159552 00000100:00100000:3.0:1787756421.657285:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787756421.657291:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb360b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287159552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756421.657325:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb360b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287159552:12345-0@lo:400:kworker.0 Request processed in 34us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756421.657331:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787756421.657352:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287159168 00000100:00100000:3.0:1787756421.657355:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287159168 00000100:00100000:3.0:1787756421.657376:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787756421.657383:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3309:x1874598287159168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756421.657408:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3309:x1874598287159168:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756421.657414:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787756421.657446:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae8472a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287159168:0@lo:400:kworker.0 00010000:00080000:3.0:1787756421.657471:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98ae84729a40 x1874598287159552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756421.657493:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae84729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287159552:0@lo:400:kworker.0 00000100:00100000:1.0:1787756421.657719:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287159936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756421.657748:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787756421.658252:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787756421.658265:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287159680 00000100:00100000:1.0:1787756421.658269:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287159680 00000100:00100000:1.0:1787756421.658319:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787756421.658327:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287159680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756421.658384:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287159680:12345-0@lo:400:kworker.0 Request processed in 57us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756421.658391:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1787756421.658552:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787756421.658626:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98ae8472ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287159680:0@lo:400:kworker.0 00000100:00100000:2.0:1787756421.662564:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287159936 00000100:00100000:2.0:1787756421.662578:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287159936 00000100:00100000:3.0:1787756421.663305:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787756421.663316:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287159936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787756421.663521:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787756421.663643:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287159936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 328us (5893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756421.663649:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787756421.666525:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca2d00 x1874598287159936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756421.666552:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287159936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787756422.175470:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287160064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787756422.175535:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756422.175598:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287160064 00000100:00100000:2.0:1787756422.175605:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287160064 00000100:00100000:2.0:1787756422.175648:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787756422.175656:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287160064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787756422.175690:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787756422.175732:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287160064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756422.175739:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787756422.175775:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca21c0 x1874598287160064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756422.175792:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287160064:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787756422.296571:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756423.081802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756423.082029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756423.082059:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264055680 00000100:00100000:3.0:1787756423.082068:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264055680 00000100:00100000:3.0:1787756423.082118:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 213 00000100:00100000:3.0:1787756423.082128:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:2364:x1874598264055680:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787756423.082206:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:2364:x1874598264055680:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 79us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756423.082214:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 213 00000100:00100000:1.0:1787756423.086006:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264055808 00000100:00100000:1.0:1787756423.086020:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264055808 00000100:00100000:1.0:1787756423.086104:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00100000:1.0:1787756423.086115:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb36083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264055808:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787756423.086208:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb36083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264055808:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 94us (4417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756423.086216:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 69 00000100:00080000:0.0:1787756423.087138:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787756423.321070:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756424.345293:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756425.369548:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756426.399679:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756426.776326:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287160576:0@lo:400:kworker.0 00000100:00100000:0.0:1787756426.776401:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756426.776455:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787756426.776461:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287160192:0@lo:400:kworker.0 00000100:00100000:0.0:1787756426.776487:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756426.776506:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287160704:0@lo:400:kworker.0 00000100:00100000:0.0:1787756426.776527:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756426.776703:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287160320:0@lo:400:kworker.0 00000100:00100000:1.0:1787756426.776731:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756426.776762:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287160832:0@lo:400:kworker.0 00000100:00100000:1.0:1787756426.776783:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756426.776818:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787756426.776825:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287160448:0@lo:400:kworker.0 00000100:00100000:1.0:1787756426.776877:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756426.776894:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287160960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756426.776916:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756426.776946:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287160576 00000100:00100000:1.0:1787756426.776953:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287160576 00000100:00100000:1.0:1787756426.777011:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287160832 00000100:00100000:1.0:1787756426.777015:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287160832 00000100:00100000:1.0:1787756426.777037:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787756426.777046:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfceed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287160576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756426.777179:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787756426.777189:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287160832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787756426.777230:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287160832:12345-0@lo:400:kworker.0 Request processed in 43us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756426.777237:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787756426.777376:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287160704 00000100:00100000:0.0:1787756426.777380:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287160704 00000100:00100000:0.0:1787756426.777412:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287160320 00000100:00100000:0.0:1787756426.777415:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287160320 00000100:00100000:0.0:1787756426.777428:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287160448 00000100:00100000:0.0:1787756426.777430:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287160448 00000100:00100000:0.0:1787756426.777442:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787756426.777447:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287160704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756426.777497:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfceed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287160576:12345-0@lo:400:kworker.0 Request processed in 452us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756426.777504:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787756426.777523:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287160192 00000100:00100000:1.0:1787756426.777526:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287160192 00000100:00100000:1.0:1787756426.777550:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787756426.777556:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3309:x1874598287160192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756426.777610:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287160704:12345-0@lo:400:kworker.0 Request processed in 161us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756426.777616:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787756426.777629:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787756426.777636:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287160320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756426.777662:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287160320:12345-0@lo:400:kworker.0 Request processed in 27us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756426.777668:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787756426.777679:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787756426.777684:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287160448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756426.777708:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287160448:12345-0@lo:400:kworker.0 Request processed in 24us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756426.777724:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1787756426.784702:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfa70780 x1874598287160576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756426.784732:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287160576:0@lo:400:kworker.0 00000100:00100000:1.0:1787756426.784871:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3309:x1874598287160192:12345-0@lo:400:kworker.0 Request processed in 7311us (8379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756426.784883:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787756426.784949:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287160960 00000100:00100000:1.0:1787756426.784957:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287160960 00000100:00100000:1.0:1787756426.785001:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787756426.785010:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287160960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787756426.785047:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787756426.785114:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287160960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (8197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756426.785126:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787756426.785144:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787756426.785160:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787756426.785163:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787756426.785203:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287160448:0@lo:400:kworker.0 00010000:00080000:1.0:1787756426.785215:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca21c0 x1874598287160960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756426.785232:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287160960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787756426.785244:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa70b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287160320:0@lo:400:kworker.0 00010000:00080000:1.0:1787756426.785256:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfcef480 x1874598287160832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756426.785264:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfcef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287160832:0@lo:400:kworker.0 00000100:00100000:2.0:1787756426.791844:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287160192:0@lo:400:kworker.0 00000100:00100000:2.0:1787756426.791869:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287160704:0@lo:400:kworker.0 00000100:00100000:1.0:1787756427.288944:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787756427.288969:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287161088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787756427.289034:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756427.289091:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287161088 00000100:00100000:1.0:1787756427.289100:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287161088 00000100:00100000:1.0:1787756427.289162:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787756427.289171:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287161088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787756427.289205:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787756427.289246:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287161088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756427.289253:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787756427.289291:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c770c0 x1874598287161088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756427.289322:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287161088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787756427.417959:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756428.202823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756428.202904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756428.203170:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264056064 00000100:00100000:0.0:1787756428.203179:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264056064 00000100:00100000:0.0:1787756428.206377:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:0.0:1787756428.206394:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264056064:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787756428.206483:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264056064:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 95us (3671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756428.206491:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 73 00000100:00100000:2.0:1787756428.206860:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264055936 00000100:00100000:2.0:1787756428.206869:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264055936 00000100:00100000:2.0:1787756428.206921:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 215 00000100:00100000:2.0:1787756428.206930:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2364:x1874598264055936:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787756428.206972:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2364:x1874598264055936:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 44us (4067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756428.206979:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 215 00000100:00080000:1.0:1787756428.211418:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787756428.441533:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756429.465296:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787756430.488035:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787756431.383725:0:11169:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787756431.511968:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756431.896215:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb36092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287161600:0@lo:400:kworker.0 00000100:00100000:3.0:1787756431.896275:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756431.896343:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787756431.896363:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287161216:0@lo:400:kworker.0 00000100:00100000:3.0:1787756431.896393:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756431.896414:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb360a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287161728:0@lo:400:kworker.0 00000100:00100000:3.0:1787756431.896437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756431.896467:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287161600 00000100:00100000:3.0:1787756431.896474:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287161600 00000100:00100000:3.0:1787756431.896521:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787756431.896530:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb360a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287161600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756431.896578:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb360a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287161600:12345-0@lo:400:kworker.0 Request processed in 49us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756431.896585:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787756431.896616:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb36092c0 x1874598287161600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756431.896629:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb36092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287161600:0@lo:400:kworker.0 00000100:00100000:1.0:1787756431.897085:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb360b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287161344:0@lo:400:kworker.0 00000100:00100000:3.0:1787756431.897230:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287161728 00000100:00100000:3.0:1787756431.897235:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287161728 00000100:00100000:3.0:1787756431.897275:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787756431.897283:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287161728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756431.897330:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874598287161728:12345-0@lo:400:kworker.0 Request processed in 48us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756431.897337:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787756431.897356:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287161216 00000100:00100000:3.0:1787756431.897360:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287161216 00000100:00100000:3.0:1787756431.897381:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787756431.897387:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3309:x1874598287161216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756431.897412:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3309:x1874598287161216:12345-0@lo:400:kworker.0 Request processed in 26us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756431.897426:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787756431.897450:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874598287161472:0@lo:400:kworker.0 00000100:00100000:3.0:1787756431.897480:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3309:1874598287161216:0@lo:400:kworker.0 00000100:00100000:3.0:1787756431.897489:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb360a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1874598287161728:0@lo:400:kworker.0 00000100:00080000:3.0:1787756431.897517:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787756431.897521:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787756431.897637:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756431.897669:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287161856:0@lo:400:kworker.0 00000100:00100000:1.0:1787756431.897691:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756431.897716:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287161856 00000100:00100000:1.0:1787756431.897719:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287161856 00000100:00100000:1.0:1787756431.897744:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787756431.897749:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287161856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787756431.897778:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287161856:12345-0@lo:400:kworker.0 Request processed in 29us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756431.897784:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787756431.897811:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3608000 x1874598287161856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787756431.897820:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287161856:0@lo:400:kworker.0 00000100:00100000:0.0:1787756431.897950:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287161344 00000100:00100000:0.0:1787756431.897954:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287161344 00000100:00100000:0.0:1787756431.897984:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787756431.897990:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287161344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756431.898031:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874598287161344:12345-0@lo:400:kworker.0 Request processed in 41us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756431.898037:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787756431.898064:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb360b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874598287161344:0@lo:400:kworker.0 00000100:00080000:3.0:1787756431.898133:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787756431.898146:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756431.898278:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287161472 00000100:00100000:0.0:1787756431.898282:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287161472 00000100:00100000:0.0:1787756431.898323:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787756431.898328:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874598287161472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756431.898365:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874598287161472:12345-0@lo:400:kworker.0 Request processed in 35us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756431.898371:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787756431.898405:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1874598287161472:0@lo:400:kworker.0 00000100:00080000:3.0:1787756431.898632:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787756431.898677:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287161984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787756431.898709:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756431.898946:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287161984 00000100:00100000:1.0:1787756431.898951:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287161984 00000100:00100000:1.0:1787756431.899021:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787756431.899029:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287161984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787756431.899056:0:6694:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787756431.899097:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287161984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756431.899110:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787756431.899180:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfca21c0 x1874598287161984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756431.899195:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287161984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787756432.409745:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287162112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787756432.409815:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787756432.409963:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287162112 00000100:00100000:1.0:1787756432.409970:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287162112 00000100:00100000:1.0:1787756432.410021:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787756432.410031:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfced2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287162112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787756432.410064:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787756432.410105:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfced2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287162112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756432.410123:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787756432.410204:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c74000 x1874598287162112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756432.410222:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287162112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787756432.536993:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756433.321482:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756433.321523:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756433.322449:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264056320 00000100:00100000:0.0:1787756433.322461:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264056320 00000100:00100000:0.0:1787756433.322530:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:0.0:1787756433.322540:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264056320:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787756433.322614:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264056320:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 74us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756433.322622:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 77 00000100:00100000:0.0:1787756433.322645:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264056192 00000100:00100000:0.0:1787756433.322649:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264056192 00000100:00100000:0.0:1787756433.322673:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 217 00000100:00100000:0.0:1787756433.322679:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2364:x1874598264056192:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:0.0:1787756433.322704:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2364:x1874598264056192:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 25us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756433.322723:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 217 00000100:00080000:0.0:1787756433.322750:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787756433.564371:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756434.587473:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787756434.965490:0:11317:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf7732c20 20000000:00000080:1.0:1787756434.965507:0:11317:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff98afb388c400 uarg=0000000000000000 20000000:01000000:1.0:1787756434.965542:0:11317:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787756434.965548:0:11317:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787756434.965552:0:11317:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787756434.967386:0:11318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787756434.967544:0:11317:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787756434.976605:0:11317:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787756434.976640:0:11317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756434.976663:0:11317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af84da7a00/0x178386880caab181 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a30 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756434.976672:0:11317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af84da7000/0x178386880caab18f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab188 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756434.976678:0:11317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98afc2045a00/0x178386880caab19d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab196 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756434.976685:0:11317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff98af81543c00/0x178386880caab1ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab1a4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756434.976707:0:11317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756434.976749:0:11317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af81543c00/0x178386880caab1ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caab1a4 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756434.976766:0:11317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af81543c00/0x178386880caab1ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caab1a4 expref: 18 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756434.976792:0:11317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c77c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11317:1874598287162240:0@lo:104: 00000100:00100000:1.0:1787756434.977009:0:11317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787756434.977178:0:11317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98afc2045a00/0x178386880caab19d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caab196 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756434.977188:0:11317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98afc2045a00/0x178386880caab19d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caab196 expref: 18 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756434.977197:0:11317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c75680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11317:1874598287162368:0@lo:104: 00000100:00100000:1.0:1787756434.977220:0:11317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787756434.981219:0:11317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af84da7000/0x178386880caab18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x178386880caab188 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756434.981240:0:11317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff98af84da7000/0x178386880caab18f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x178386880caab188 expref: 18 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756434.981256:0:11317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c770c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11317:1874598287162496:0@lo:104: 00000100:00100000:1.0:1787756434.981310:0:11317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756434.987746:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287162240 00000100:00100000:3.0:1787756434.987760:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287162240 00000100:00100000:3.0:1787756434.987850:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287162368 00000100:00100000:3.0:1787756434.987854:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287162368 00000100:00100000:3.0:1787756434.987874:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787756434.987884:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:11317:x1874598287162240:12345-0@lo:104: 00010000:00010000:3.0:1787756434.987900:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.987985:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787756434.987992:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+4:11317:x1874598287162240:12345-0@lo:104: Request processed in 110us (10983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756434.988000:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787756434.988018:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787756434.988039:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:11317:x1874598287162368:12345-0@lo:104: 00010000:00010000:3.0:1787756434.988047:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.988081:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787756434.988086:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:11317:x1874598287162368:12345-0@lo:104: Request processed in 49us (10866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756434.988105:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787756434.988402:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787756434.988408:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.988415:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81542000 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:3.0:1787756434.988419:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.988427:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787756434.988434:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787756434.988439:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787756434.988481:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.988488:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787756434.988509:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.988527:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af81542000/0x178386880caab1a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab1ab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.988539:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787756434.988542:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.988547:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81543e00 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:3.0:1787756434.988551:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.988556:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787756434.988562:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787756434.988567:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787756434.988582:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.988588:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787756434.988603:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.988609:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af81543e00/0x178386880caab196 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab19d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.990930:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756434.990948:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756434.990950:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756434.990962:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756434.990982:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287162624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787756434.991047:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756434.991124:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287162752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787756434.991148:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787756434.991378:0:11317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff98af84da7a00/0x178386880caab181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a30 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756434.991408:0:11317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff98af84da7a00/0x178386880caab181 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a30 expref: 9 pid: 5835 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756434.991420:0:11317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c761c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11317:1874598287162880:192.168.203.21@tcp:104: 00000100:00100000:1.0:1787756434.991467:0:11317:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af8816c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787756434.991494:0:11317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c77c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11317:1874598287162240:0@lo:104: 00000100:00100000:1.0:1787756434.991504:0:11317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c75680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11317:1874598287162368:0@lo:104: 00000100:00100000:2.0:1787756434.991626:0:8523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287162496 00000100:00100000:2.0:1787756434.991633:0:8523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287162496 00000100:00100000:2.0:1787756434.991650:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287162624 00000100:00100000:2.0:1787756434.991652:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287162624 00010000:00010000:2.0:1787756434.991679:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af81543c00/0x178386880caab1ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab1a4 expref: 19 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756434.991713:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287162752 00000100:00100000:2.0:1787756434.991716:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287162752 00010000:00010000:2.0:1787756434.991727:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98afc2045a00/0x178386880caab19d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab196 expref: 20 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756434.991746:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787756434.991755:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af85b1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+20:3310:x1874598287162624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787756434.991766:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787756434.991858:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af81543c00/0x178386880caab1ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab1a4 expref: 20 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.991869:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af81543c00/0x178386880caab1ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caab1a4 expref: 20 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.991887:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af81543c00/0x178386880caab1ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caab1a4 expref: 20 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.991901:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787756434.991942:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af85b1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3310:x1874598287162624:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756434.991950:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787756434.991992:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787756434.991999:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:3311:x1874598287162752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787756434.992006:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787756434.992010:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98afc2045a00/0x178386880caab19d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab196 expref: 18 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.992019:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98afc2045a00/0x178386880caab19d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caab196 expref: 18 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.992030:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afc2045a00/0x178386880caab19d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caab196 expref: 18 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.992039:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787756434.992066:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:3311:x1874598287162752:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756434.992073:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787756434.992126:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287162624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787756434.992160:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3311:1874598287162752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787756434.992201:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787756434.992209:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c74b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:11317:x1874598287162496:12345-0@lo:104: 00010000:00010000:2.0:1787756434.992220:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.992260:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787756434.992265:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c74b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+3:11317:x1874598287162496:12345-0@lo:104: Request processed in 58us (10956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756434.992271:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787756434.992286:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787756434.992291:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.992298:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81542600 already unused, calling callback (ffffffffc1c5dc20) 10000000:00010000:2.0:1787756434.992301:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.992309:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787756434.992317:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787756434.992322:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787756434.992347:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.992353:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787756434.992375:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.992382:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.121@tcp lock: ffff98af81542600/0x178386880caab188 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x178386880caab18f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756434.992395:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756434.992397:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756434.992398:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787756434.992414:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287163008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787756434.994196:0:11317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c770c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11317:1874598287162496:0@lo:104: 00000100:00100000:2.0:1787756434.994367:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756434.997451:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287163008 00000100:00100000:3.0:1787756434.997464:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287163008 00010000:00010000:3.0:1787756434.997501:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af84da7000/0x178386880caab18f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab188 expref: 17 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756434.997574:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787756434.997584:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa70b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:3312:x1874598287163008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787756434.997597:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787756434.997602:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af84da7000/0x178386880caab18f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x178386880caab188 expref: 17 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.997614:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af84da7000/0x178386880caab18f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x178386880caab188 expref: 17 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.997633:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da7000/0x178386880caab18f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x178386880caab188 expref: 17 pid: 5837 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756434.997646:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787756434.997738:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa70b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:3312:x1874598287163008:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (3371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756434.997745:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787756435.002643:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287163008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787756435.002983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756435.003051:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264056448 00000100:00100000:2.0:1787756435.003058:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264056448 00010000:00010000:2.0:1787756435.003103:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff98af84da7a00/0x178386880caab181 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a30 expref: 10 pid: 5835 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756435.003140:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:2.0:1787756435.003149:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2366:x1874598264056448:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787756435.003162:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787756435.003168:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff98af84da7a00/0x178386880caab181 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a30 expref: 10 pid: 5835 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756435.003179:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff98af84da7a00/0x178386880caab181 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a30 expref: 10 pid: 5835 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756435.003201:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756435.003209:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756435.003239:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756435.003245:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756435.003251:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756435.003257:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756435.003263:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afb3845800 already unused, calling callback (ffffffffc162d530) 00010000:00010000:2.0:1787756435.003267:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756435.003275:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756435.003284:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756435.003294:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787756435.003346:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2366:x1874598264056448:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 198us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756435.003355:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00010000:00010000:1.0:1787756435.003708:0:11317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98af84da7a00/0x178386880caab181 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a30 expref: 9 pid: 5835 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756435.003722:0:11317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c761c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11317:1874598287162880:192.168.203.21@tcp:104: 00010000:00010000:1.0:1787756435.003745:0:11317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756435.003753:0:11317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756435.003759:0:11317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756435.003765:0:11317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff98afb3845800/0x178386880caab1b2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756435.609114:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756436.522289:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756436.522374:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264056576 00000100:00100000:2.0:1787756436.522383:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264056576 00000100:00100000:2.0:1787756436.522441:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 218 00000100:00100000:2.0:1787756436.522451:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+9:5605:x1874598264056576:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787756436.522481:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756436.522502:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98afc2044600/0x178386880caab1b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a37 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756436.522530:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98afc2044600/0x178386880caab1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a37 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756436.522542:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98afc2044600/0x178386880caab1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a37 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756436.522550:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2044600, rc 0) 00000100:00100000:2.0:1787756436.522611:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264056576:12345-192.168.203.21@tcp:101:ll_cfg_requeue.0 Request processed in 161us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756436.522619:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 218 00000100:00100000:0.0:1787756436.526410:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756436.526777:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264056704 00000100:00100000:3.0:1787756436.526787:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264056704 00000100:00100000:3.0:1787756436.526878:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 219 00000100:00100000:3.0:1787756436.526888:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264056704:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756436.527263:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264056704:12345-192.168.203.21@tcp:501:ll_cfg_requeue.0 Request processed in 362us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756436.527273:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 219 00000100:00100000:3.0:1787756436.531577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756436.531648:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264056832 00000100:00100000:0.0:1787756436.531657:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264056832 00000100:00100000:0.0:1787756436.531754:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 220 00000100:00100000:0.0:1787756436.531765:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264056832:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787756436.532027:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:5605:x1874598264056832:12345-192.168.203.21@tcp:503:ll_cfg_requeue.0 Request processed in 262us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756436.532035:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 220 00010000:00010000:2.0:1787756436.634926:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787756436.826759:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787756436.826767:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98af85ba0800 from 7 10000000:01000000:2.0:1787756436.826773:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787756436.826818:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2045a00/0x178386880caab1c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756436.826854:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98afc2045a00/0x178386880caab1c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756436.826865:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98afc2045a00/0x178386880caab1c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756436.826894:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa70780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787756436.827546:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756436.827611:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98ae81fbe180 going to sleep for 11 seconds 00000100:00100000:3.0:1787756436.829160:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287163136 00000100:00100000:3.0:1787756436.829172:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287163136 00000100:00100000:3.0:1787756436.829240:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787756436.829250:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+16:5839:x1874598287163136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787756436.829267:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756436.829286:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da7000/0x178386880caab1c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab1c0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756436.829314:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da7000/0x178386880caab1c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab1c0 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756436.829324:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da7000/0x178386880caab1c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab1c0 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756436.829332:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7000, rc 0) 00000100:00100000:3.0:1787756436.829406:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287163136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756436.829413:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787756436.830063:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa70780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787756436.830092:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98afc2045a00/0x178386880caab1c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756436.830103:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98afc2045a00/0x178386880caab1c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab1c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756436.830173:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfcef840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787756436.830213:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756436.830257:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af90d5e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787756436.831077:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287163264 00000100:00100000:2.0:1787756436.831095:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287163264 00000100:00100000:2.0:1787756436.831145:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787756436.831155:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287163264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787756436.831437:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287163264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756436.831445:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787756436.831671:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfcef840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787756436.831712:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfcef840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787756436.831762:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756436.831794:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af90d5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756436.831810:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287163392 00000100:00100000:0.0:1787756436.831814:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287163392 00000100:00100000:0.0:1787756436.831878:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787756436.831885:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287163392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787756436.832028:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287163392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756436.832036:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787756436.832070:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfcef840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787756436.834414:0:11373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787756436.834778:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787756436.834799:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787756436.834812:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98afc2045a00/0x178386880caab1c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756436.834872:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98afc2045a00/0x178386880caab1c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787756436.834884:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787756436.834886:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98afb3fb3800 from 7 10000000:01000000:0.0:1787756436.834889:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787756436.834926:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af81543200/0x178386880caab1ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756436.834944:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af81543200/0x178386880caab1ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756436.834954:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af81543200/0x178386880caab1ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756436.834993:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfcef840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787756436.835053:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756436.835103:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af90d5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756436.835267:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287163520 00000100:00100000:3.0:1787756436.835274:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287163520 00000100:00100000:3.0:1787756436.835323:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787756436.835332:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+17:5839:x1874598287163520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787756436.835344:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756436.835355:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af84da6a00/0x178386880caab1d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab1ce expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756436.835378:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af84da6a00/0x178386880caab1d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab1ce expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756436.835389:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af84da6a00/0x178386880caab1d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab1ce expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756436.835398:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da6a00, rc 0) 00000100:00100000:3.0:1787756436.835445:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287163520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756436.835452:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787756436.836457:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfcef840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787756436.836475:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af81543200/0x178386880caab1ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756436.836486:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af81543200/0x178386880caab1ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab1d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756436.836542:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfcef840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787756436.836580:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756436.836614:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af90d5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787756436.837010:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287163648 00000100:00100000:3.0:1787756436.837016:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287163648 00000100:00100000:3.0:1787756436.837058:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787756436.837067:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287163648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756436.840216:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287163648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3141us (3626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756436.840230:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787756436.843073:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfcef840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756436.851077:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787756436.851177:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756436.851221:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98afbfd5b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787756436.851323:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287163776 00000100:00100000:0.0:1787756436.851331:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287163776 00000100:00100000:0.0:1787756436.851385:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787756436.851393:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af8693e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287163776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787756436.851570:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af8693e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287163776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756436.851578:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787756436.851816:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787756436.859380:0:11374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787756436.862162:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787756436.862197:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787756436.862209:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af81543200/0x178386880caab1ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756436.862222:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af81543200/0x178386880caab1ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1d5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787756436.862233:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787756436.862236:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff98af903a6800 from 7 10000000:01000000:3.0:1787756436.862239:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787756436.862279:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caab1dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756436.862287:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caab1dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756436.862299:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caab1dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756436.862324:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787756436.862391:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756436.862442:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af835266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756436.862507:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287163904 00000100:00100000:0.0:1787756436.862515:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287163904 00000100:00100000:0.0:1787756436.862567:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787756436.862576:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+18:5839:x1874598287163904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787756436.862599:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756436.862623:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff98af81542e00/0x178386880caab1e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x178386880caab1dc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756436.862646:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff98af81542e00/0x178386880caab1e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x178386880caab1dc expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756436.862657:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff98af81542e00/0x178386880caab1e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x178386880caab1dc expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756436.862665:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af81542e00, rc 0) 00000100:00100000:0.0:1787756436.862710:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287163904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756436.862716:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787756436.863741:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287163904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787756436.863762:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caab1dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1e3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756436.863774:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caab1dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x178386880caab1e3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756436.863896:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287164032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756436.864145:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756436.864186:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af835266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756436.864229:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287164032 00000100:00100000:0.0:1787756436.864236:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287164032 00000100:00100000:0.0:1787756436.864277:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787756436.864285:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287164032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787756436.864531:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287164032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756436.864539:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787756436.864621:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287164032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787756436.864653:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287164160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787756436.864692:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756436.864715:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af835266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787756436.864815:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287164160 00000100:00100000:0.0:1787756436.864850:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287164160 00000100:00100000:0.0:1787756436.864877:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787756436.864884:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287164160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787756436.865028:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:5839:x1874598287164160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756436.865044:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787756436.865245:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc68780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:5839:1874598287164160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787756436.880527:0:11375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787756436.885245:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787756436.885280:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787756436.885291:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caab1dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1e3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756436.885303:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.121@tcp lock: ffff98af84da6800/0x178386880caab1dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x178386880caab1e3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756437.016158:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287164416:0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.016228:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756437.016296:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787756437.016302:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfcecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287164288:0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.016326:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756437.016480:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfcec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287164800:0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.016510:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756437.016546:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfceda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287164544:0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.016570:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756437.016590:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787756437.016596:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfcee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287164672:0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.016616:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756437.016648:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287164416 00000100:00100000:0.0:1787756437.016655:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287164416 00000100:00100000:0.0:1787756437.016714:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287164288 00000100:00100000:0.0:1787756437.016718:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287164288 00000100:00100000:0.0:1787756437.016732:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287164672 00000100:00100000:0.0:1787756437.016735:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287164672 00000100:00100000:0.0:1787756437.016752:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787756437.016760:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287164416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.016810:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874598287164416:12345-0@lo:400:kworker.0 Request processed in 50us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756437.016818:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787756437.016860:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787756437.016867:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287164288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.016908:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcefc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287164288:12345-0@lo:400:kworker.0 Request processed in 42us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756437.016915:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787756437.016927:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787756437.016934:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287164672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.016965:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287164672:12345-0@lo:400:kworker.0 Request processed in 32us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756437.016971:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787756437.016992:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287164800 00000100:00100000:0.0:1787756437.016995:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287164800 00000100:00100000:0.0:1787756437.017019:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287164544 00000100:00100000:0.0:1787756437.017022:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287164544 00000100:00100000:0.0:1787756437.017042:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787756437.017049:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287164800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.017091:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287164800:12345-0@lo:400:kworker.0 Request processed in 31us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756437.017098:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787756437.017450:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787756437.017458:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287164544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.017551:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287164544:12345-0@lo:400:kworker.0 Request processed in 94us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756437.017556:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787756437.017581:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787756437.017584:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787756437.017586:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787756437.017620:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfcee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287164672:0@lo:400:kworker.0 00010000:00080000:0.0:1787756437.017644:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfceda40 x1874598287164544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756437.017654:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfceda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287164544:0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.017681:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfcecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287164288:0@lo:400:kworker.0 00010000:00080000:0.0:1787756437.017690:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfcec3c0 x1874598287164800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756437.017698:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfcec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287164800:0@lo:400:kworker.0 00000100:00100000:0.0:1787756437.017707:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1874598287164416:0@lo:400:kworker.0 00000100:00100000:3.0:1787756437.019500:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787756437.019521:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287164928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787756437.019581:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756437.019628:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287164928 00000100:00100000:3.0:1787756437.019634:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287164928 00000100:00100000:3.0:1787756437.019677:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787756437.019686:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287164928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787756437.019716:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787756437.019752:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287164928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756437.019759:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787756437.019791:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfa70780 x1874598287164928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756437.019809:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287164928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787756437.533332:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287165056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787756437.533404:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756437.533903:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287165056 00000100:00100000:3.0:1787756437.533913:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287165056 00000100:00100000:3.0:1787756437.533960:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787756437.533970:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287165056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787756437.534004:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787756437.534060:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287165056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756437.534067:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787756437.534144:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfced680 x1874598287165056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787756437.534162:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287165056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787756437.655999:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787756438.442707:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756438.442769:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756438.442905:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264057088 00000100:00100000:2.0:1787756438.442905:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264056960 00000100:00100000:2.0:1787756438.442915:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264056960 00000100:00100000:1.0:1787756438.442919:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264057088 00000100:00100000:1.0:1787756438.442967:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00100000:2.0:1787756438.442967:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 230 00000100:00100000:1.0:1787756438.442976:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264057088:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:2.0:1787756438.442976:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2364:x1874598264056960:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787756438.443043:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+6:2364:x1874598264057088:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 68us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756438.443051:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 81 00000100:00080000:0.0:1787756438.443170:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787756438.450429:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da773933-0c5c-4731-bbda-bf23609f1b54+10:2364:x1874598264056960:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 7441us (7646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756438.450442:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 230 00010000:00010000:2.0:1787756438.681475:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787756439.450670:0:11514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg321-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787756439.706227:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787756440.727987:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756441.752771:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756442.136096:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787756442.136117:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287165184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787756442.136180:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756442.137190:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287165568:0@lo:400:kworker.0 00000100:00100000:3.0:1787756442.137230:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756442.137255:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787756442.137260:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287165696:0@lo:400:kworker.0 00000100:00100000:3.0:1787756442.137282:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756442.137363:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287165440:0@lo:400:kworker.0 00000100:00100000:2.0:1787756442.137391:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756442.137418:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787756442.137424:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287165312:0@lo:400:kworker.0 00000100:00100000:2.0:1787756442.137448:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787756442.137466:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb360b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287165824:0@lo:400:kworker.0 00000100:00100000:2.0:1787756442.137487:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756442.137547:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287165568 00000100:00100000:3.0:1787756442.137555:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287165568 00000100:00100000:3.0:1787756442.137613:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287165696 00000100:00100000:3.0:1787756442.137618:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287165696 00000100:00100000:3.0:1787756442.137632:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287165440 00000100:00100000:3.0:1787756442.137635:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287165440 00000100:00100000:3.0:1787756442.137649:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787756442.137657:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287165568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756442.137723:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874598287165568:12345-0@lo:400:kworker.0 Request processed in 66us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756442.137731:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787756442.137752:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787756442.137758:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb360a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287165696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756442.137783:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb360a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874598287165696:12345-0@lo:400:kworker.0 Request processed in 26us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756442.137788:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787756442.137799:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787756442.137804:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287165440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756442.137853:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874598287165440:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756442.137858:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787756442.137875:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287165312 00000100:00100000:3.0:1787756442.137878:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287165312 00000100:00100000:3.0:1787756442.137900:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787756442.137906:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3310:x1874598287165312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756442.137932:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3310:x1874598287165312:12345-0@lo:400:kworker.0 Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756442.137939:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787756442.137981:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3310:1874598287165312:0@lo:400:kworker.0 00000100:00100000:3.0:1787756442.137993:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874598287165440:0@lo:400:kworker.0 00000100:00100000:3.0:1787756442.138019:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1874598287165696:0@lo:400:kworker.0 00000100:00100000:3.0:1787756442.138027:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfc6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1874598287165568:0@lo:400:kworker.0 00000100:00080000:2.0:1787756442.138106:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787756442.138173:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287165824 00000100:00100000:0.0:1787756442.138178:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287165824 00000100:00100000:0.0:1787756442.138222:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787756442.138229:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287165824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756442.138274:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287165824:12345-0@lo:400:kworker.0 Request processed in 45us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756442.138280:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787756442.138306:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb360b0c0 x1874598287165824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756442.138324:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb360b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287165824:0@lo:400:kworker.0 00000100:00080000:2.0:1787756442.138378:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787756442.142134:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287165184 00000100:00100000:1.0:1787756442.142150:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287165184 00000100:00100000:1.0:1787756442.142236:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787756442.142246:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287165184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787756442.142283:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787756442.142372:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287165184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (6192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756442.142380:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1787756442.142469:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787756442.142542:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfa72940 x1874598287165184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756442.142564:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287165184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787756442.649428:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfceda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287165952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787756442.649503:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756442.649635:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287165952 00000100:00100000:0.0:1787756442.649643:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287165952 00000100:00100000:0.0:1787756442.649696:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787756442.649705:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287165952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787756442.649741:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756442.649794:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874598287165952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756442.649802:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787756442.649867:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfceda40 x1874598287165952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756442.649884:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfceda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1874598287165952:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787756442.776000:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787756443.271161:0:11614:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: finish setup 11:00:42 (1787756442) === 00000100:00100000:3.0:1787756443.552657:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756443.552708:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756443.552871:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264057216 00000100:00100000:1.0:1787756443.552881:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264057216 00000100:00100000:1.0:1787756443.552942:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00100000:1.0:1787756443.552951:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb36092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+6:2365:x1874598264057216:12345-192.168.203.21@tcp:41:mkdir.0 00000004:00000024:1.0:1787756443.552992:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787756443.553085:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb36092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+6:2365:x1874598264057216:12345-192.168.203.21@tcp:41:mkdir.0 Request processed in 135us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756443.553092:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 10 00000100:00080000:2.0:1787756443.553256:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787756443.553728:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264057344 00000100:00100000:0.0:1787756443.553748:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264057344 00000100:00100000:0.0:1787756443.553789:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1787756443.553797:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bcdd3d25-193d-42cb-911a-069eb2969705+6:9866:x1874598264057344:12345-192.168.203.21@tcp:700:mkdir.0 00000100:00100000:0.0:1787756443.553878:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bcdd3d25-193d-42cb-911a-069eb2969705+6:9866:x1874598264057344:12345-192.168.203.21@tcp:700:mkdir.0 Request processed in 82us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756443.553885:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:3.0:1787756443.561882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756443.561961:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264057600 00000100:00100000:0.0:1787756443.561981:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264057600 00000100:00100000:0.0:1787756443.562099:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:0.0:1787756443.562117:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb360b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+6:9866:x1874598264057600:12345-192.168.203.21@tcp:36:mkdir.0 00010000:00010000:0.0:1787756443.562164:0:8218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756443.562219:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af80030400/0x178386880caab0fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a1b expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.562238:0:8218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08600) 00010000:00010000:0.0:1787756443.562248:0:8218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787756443.563133:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab1ea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.563149:0:8218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab1ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.563159:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab1ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.563188:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab1f1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.563195:0:8218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.563202:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787756443.564565:0:8218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787756443.564579:0:8218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab1ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.564587:0:8218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab1ea lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.564600:0:8218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab1ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.564606:0:8218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81543a00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:0.0:1787756443.564610:0:8218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab1ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.564619:0:8218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab1ea lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.564631:0:8218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08e00) 00010000:00010000:0.0:1787756443.564635:0:8218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787756443.564639:0:8218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab1ea lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.564645:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab1ea lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787756443.564662:0:8218:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d36401a reply state 000000004e28103c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756443.564671:0:8218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787756443.564749:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb360b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+7:9866:x1874598264057600:12345-192.168.203.21@tcp:36:mkdir.0 Request processed in 2638us (2915us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787756443.564757:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 11 00000100:00100000:1.0:1787756443.565531:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756443.565608:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264057728 00000100:00100000:3.0:1787756443.565624:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264057728 00000100:00100000:3.0:1787756443.565671:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 232 00000100:00100000:3.0:1787756443.565679:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264057728:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:3.0:1787756443.565726:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264057728:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 48us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756443.565745:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 232 00010000:00010000:3.0:1787756443.569081:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab1f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.569098:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab1f1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.569105:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.569111:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81542000 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:3.0:1787756443.569116:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab1f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.569125:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab1f1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.569144:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98afa0b08b00) 00010000:00010000:3.0:1787756443.569160:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787756443.569166:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab1f1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.569172:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab1f1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756443.584494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756443.591907:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264057856 00000100:00100000:3.0:1787756443.591922:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264057856 00000100:00100000:3.0:1787756443.591992:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:3.0:1787756443.592003:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:9867:x1874598264057856:12345-192.168.203.21@tcp:101:chmod.0 00010000:00010000:3.0:1787756443.592024:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756443.592059:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab1f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a3e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.592123:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab1ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.592137:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab1ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.592148:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab1ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787756443.592207:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787756443.592211:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787756443.592253:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab1ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.592280:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab1f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a3e expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.592316:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab1ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a3e expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.592324:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af85ff0400) 00010000:00010000:3.0:1787756443.592327:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787756443.592331:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da6c00, rc 0) 00000100:00100000:3.0:1787756443.592392:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+7:9867:x1874598264057856:12345-192.168.203.21@tcp:101:chmod.0 Request processed in 390us (7908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756443.592398:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1787756443.596578:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756443.596687:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264058112 00000100:00100000:2.0:1787756443.596697:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264058112 00000100:00100000:2.0:1787756443.596759:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:2.0:1787756443.596768:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+7:9867:x1874598264058112:12345-192.168.203.21@tcp:36:chmod.0 00010000:00010000:2.0:1787756443.596818:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787756443.596878:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab1ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a3e expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.596897:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af85ff0400) 00010000:00010000:2.0:1787756443.596906:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787756443.596929:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab206 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.596941:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.596950:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787756443.597268:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000235a7310 reply state 00000000d3836a4f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756443.597277:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787756443.597290:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787756443.597363:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+8:9867:x1874598264058112:12345-192.168.203.21@tcp:36:chmod.0 Request processed in 595us (794us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787756443.597371:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00010000:00010000:1.0:1787756443.603473:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.603494:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab206 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.603503:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab206 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.603510:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2045200 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:1.0:1787756443.603516:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab206 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.603524:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab206 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.603547:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af8995fa00) 00010000:00010000:1.0:1787756443.603550:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787756443.603556:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab206 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.603562:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab206 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756443.620593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756443.620900:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264058240 00000100:00100000:3.0:1787756443.620911:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264058240 00000100:00100000:3.0:1787756443.620962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:3.0:1787756443.620970:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+7:9868:x1874598264058240:12345-192.168.203.21@tcp:101:chown.0 00010000:00010000:3.0:1787756443.620992:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756443.621013:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab20d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.621103:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7200/0x178386880caab214 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.621117:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7200/0x178386880caab214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.621129:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7200/0x178386880caab214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787756443.621206:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787756443.621222:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787756443.621269:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7200/0x178386880caab214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.621295:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab20d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a45 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.621313:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7200/0x178386880caab214 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a45 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.621322:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af85ff0f00) 00010000:00010000:3.0:1787756443.621325:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787756443.621328:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7200, rc 0) 00000100:00100000:3.0:1787756443.621395:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+8:9868:x1874598264058240:12345-192.168.203.21@tcp:101:chown.0 Request processed in 425us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756443.621403:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:0.0:1787756443.629763:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756443.629878:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264058368 00000100:00100000:2.0:1787756443.629888:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264058368 00000100:00100000:2.0:1787756443.629937:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:2.0:1787756443.629946:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+8:9868:x1874598264058368:12345-192.168.203.21@tcp:101:chown.0 00010000:00010000:2.0:1787756443.629965:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756443.629984:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab21b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a4c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630054:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab222 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630067:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab222 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630078:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab222 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630092:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab229 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630098:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630117:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630242:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630252:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630259:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787756443.630298:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787756443.630302:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787756443.630327:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630341:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab222 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630347:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab222 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630354:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab222 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630360:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2044800 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:2.0:1787756443.630364:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab222 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630372:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab222 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630391:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af85ff0f00) 00010000:00010000:2.0:1787756443.630394:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787756443.630400:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630406:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630418:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630424:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab229 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630434:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab229 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630439:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2045e00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:2.0:1787756443.630441:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab229 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630448:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab229 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630455:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98af8995f300) 00010000:00010000:2.0:1787756443.630457:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787756443.630459:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab229 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630465:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab229 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630507:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab21b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a4c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630520:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a4c expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.630528:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98af8995f200) 00010000:00010000:2.0:1787756443.630530:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787756443.630532:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2045200, rc 0) 00000100:00100000:2.0:1787756443.630818:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+9:9868:x1874598264058368:12345-192.168.203.21@tcp:101:chown.0 Request processed in 869us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756443.630826:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 15 00000100:00100000:2.0:1787756443.635015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756443.635260:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264058624 00000100:00100000:3.0:1787756443.635269:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264058624 00000100:00100000:3.0:1787756443.635369:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 16 00000100:00100000:3.0:1787756443.635379:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+9:9868:x1874598264058624:12345-192.168.203.21@tcp:36:chown.0 00010000:00010000:3.0:1787756443.635428:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787756443.635455:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a4c expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.635473:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98af8995f200) 00010000:00010000:3.0:1787756443.635482:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787756443.635506:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab237 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.635536:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.635546:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787756443.670850:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1787756443.670865:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1787756443.670871:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1787756443.670937:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfb9076e reply state 00000000319ee485 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756443.670951:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787756443.671124:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1787756443.671361:0:5842:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787756443.671382:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+7:9868:x1874598264058624:12345-192.168.203.21@tcp:36:chown.0 Request processed in 36000us (36371us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787756443.671391:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 16 00010000:00010000:0.0:1787756443.671427:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.671436:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab237 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.671444:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab237 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.671451:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af84da7400 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:0.0:1787756443.671456:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab237 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.671465:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab237 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.671483:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98af85ff0800) 00010000:00010000:0.0:1787756443.671486:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787756443.671491:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab237 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.671498:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab237 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756443.685416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756443.685510:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264058752 00000100:00100000:0.0:1787756443.685521:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264058752 00000100:00100000:0.0:1787756443.685596:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:0.0:1787756443.685606:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+6:9869:x1874598264058752:12345-192.168.203.21@tcp:101:touch.500 00010000:00010000:0.0:1787756443.685644:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756443.685666:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab23e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a53 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787756443.687701:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1981us 00010000:00010000:1.0:1787756443.698326:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845600/0x178386880caab245 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.698348:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845600/0x178386880caab245 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.698368:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845600/0x178386880caab245 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.698385:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab24c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.698392:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.698398:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.698862:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844c00/0x178386880caab253 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.698871:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844c00/0x178386880caab253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.698878:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844c00/0x178386880caab253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787756443.698958:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787756443.698963:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787756443.699074:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844c00/0x178386880caab253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699087:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845600/0x178386880caab245 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699094:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845600/0x178386880caab245 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699111:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845600/0x178386880caab245 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699118:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afb3845600 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:1.0:1787756443.699122:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845600/0x178386880caab245 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699131:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845600/0x178386880caab245 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699145:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af85ff0f00) 00010000:00010000:1.0:1787756443.699149:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787756443.699154:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845600/0x178386880caab245 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699161:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845600/0x178386880caab245 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699173:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699180:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab24c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699186:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab24c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699191:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afb3844800 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:1.0:1787756443.699195:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab24c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699211:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab24c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699220:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98afa5da7600) 00010000:00010000:1.0:1787756443.699223:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787756443.699226:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab24c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699232:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab24c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699267:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab23e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a53 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699282:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844c00/0x178386880caab253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a53 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.699288:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98afa5da7c00) 00010000:00010000:1.0:1787756443.699290:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787756443.699292:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afb3844c00, rc 0) 00000100:00100000:1.0:1787756443.699364:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+7:9869:x1874598264058752:12345-192.168.203.21@tcp:101:touch.500 Request processed in 13758us (13955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756443.699374:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 17 00000100:00100000:0.0:1787756443.703935:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756443.704048:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264059008 00000100:00100000:1.0:1787756443.704057:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264059008 00000100:00100000:1.0:1787756443.704115:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:1.0:1787756443.704124:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+7:9869:x1874598264059008:12345-192.168.203.21@tcp:101:touch.500 00010000:00010000:1.0:1787756443.704159:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787756443.704178:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845800/0x178386880caab25a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a5a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.704484:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844000/0x178386880caab261 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.704500:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844000/0x178386880caab261 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.704511:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844000/0x178386880caab261 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.704720:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845c00/0x178386880caab268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.704730:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845c00/0x178386880caab268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.704737:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845c00/0x178386880caab268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787756443.706285:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787756443.706768:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab26f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.706785:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab26f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.706796:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab26f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.706861:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844000/0x178386880caab261 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.706869:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844000/0x178386880caab261 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.706875:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844000/0x178386880caab261 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.706881:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afb3844000 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:1.0:1787756443.706885:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844000/0x178386880caab261 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.706891:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844000/0x178386880caab261 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.706903:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98afa5da7c00) 00010000:00010000:1.0:1787756443.706906:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787756443.706910:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844000/0x178386880caab261 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.706917:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844000/0x178386880caab261 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787756443.706929:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1cab493 reply state 000000006c66eec4 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845c00/0x178386880caab268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787756443.706937:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787756443.706971:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845800/0x178386880caab25a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a5a expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.706997:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab26f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a5a expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.707004:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98afa5da7600) 00010000:00010000:1.0:1787756443.707007:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787756443.707009:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afb3844800, rc 0) 00000100:00100000:1.0:1787756443.707143:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+10:9869:x1874598264059008:12345-192.168.203.21@tcp:101:touch.500 Request processed in 3019us (3215us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787756443.707151:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 18 00000100:00100000:0.0:1787756443.712230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756443.712290:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264059264 00000100:00100000:2.0:1787756443.712299:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264059264 00000100:00100000:2.0:1787756443.712354:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 19 00000100:00100000:2.0:1787756443.712363:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfceda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+10:9869:x1874598264059264:12345-192.168.203.21@tcp:36:touch.500 00010000:00010000:2.0:1787756443.712418:0:8218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787756443.712443:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844800/0x178386880caab26f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a5a expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.712460:0:8218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98afa5da7600) 00010000:00010000:2.0:1787756443.712469:0:8218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787756443.712510:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab27d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.712551:0:8218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab27d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.712561:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab27d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787756443.712691:0:8218:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d5be9ae reply state 00000000cd00db61 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab27d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756443.712700:0:8218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787756443.712855:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845c00/0x178386880caab268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.712864:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845c00/0x178386880caab268 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.712870:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845c00/0x178386880caab268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.712877:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afb3845c00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:3.0:1787756443.712881:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845c00/0x178386880caab268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.712889:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845c00/0x178386880caab268 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.712899:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x65d33690 (ffff98afa5da7300) 00010000:00010000:3.0:1787756443.712901:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787756443.712905:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845c00/0x178386880caab268 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.712911:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845c00/0x178386880caab268 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756443.714390:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfceda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+10:9869:x1874598264059264:12345-192.168.203.21@tcp:36:touch.500 Request processed in 2020us (2160us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787756443.714400:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 19 00010000:00010000:1.0:1787756443.717469:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab27d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.717486:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab27d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.717493:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab27d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.717500:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2044c00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:1.0:1787756443.717504:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab27d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.717512:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab27d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.717527:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98af8995f300) 00010000:00010000:1.0:1787756443.717530:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787756443.717545:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab27d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.717566:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab27d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756443.717877:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756443.717935:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264059392 00000100:00100000:0.0:1787756443.717945:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264059392 00000100:00100000:0.0:1787756443.717994:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:0.0:1787756443.718004:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+9:9869:x1874598264059392:12345-192.168.203.21@tcp:101:touch.500 00010000:00010000:0.0:1787756443.718026:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756443.718053:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a61 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.718119:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a61 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.718134:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a61 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.718151:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98afa0b08e00) 00010000:00010000:0.0:1787756443.718154:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787756443.718157:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af81543c00, rc 0) 00000100:00100000:0.0:1787756443.718213:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+10:9869:x1874598264059392:12345-192.168.203.21@tcp:101:touch.500 Request processed in 210us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756443.718219:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 20 00000100:00100000:0.0:1787756443.721138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756443.721208:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264059520 00000100:00100000:1.0:1787756443.721217:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264059520 00000100:00100000:1.0:1787756443.721258:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:1.0:1787756443.721265:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874598264059520:12345-192.168.203.21@tcp:8:touch.500 00010000:00080000:1.0:1787756443.721293:0:6693:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp t0 exp 0000000000000000 cur 302 last 0 00000020:00000080:1.0:1787756443.721320:0:6693:0:(genops.c:1385:class_connect()) connect: client bcdd3d25-193d-42cb-911a-069eb2969705, cookie 0x178386880caab28b 00002000:00100000:1.0:1787756443.721331:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bcdd3d25-193d-42cb-911a-069eb2969705/ffff98ae833d4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787756443.721341:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787756443.721686:0:6693:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787756443.721782:0:6693:0:(import.c:65:import_set_state_nolock()) ffff98ae833d1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787756443.722232:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bcdd3d25-193d-42cb-911a-069eb2969705+6:2362:x1874598264059520:12345-192.168.203.21@tcp:8:touch.500 Request processed in 964us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756443.722241:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 12 00000100:00100000:3.0:1787756443.725539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756443.725629:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264059648 00000100:00100000:0.0:1787756443.725639:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264059648 00000100:00100000:0.0:1787756443.725704:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:0.0:1787756443.725722:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afa7fc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:0:x1874598264059648:12345-192.168.203.21@tcp:2:touch.500 00000100:00080000:2.0:1787756443.725820:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787756443.774297:0:6717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1787756443.774332:0:6717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bcdd3d25-193d-42cb-911a-069eb2969705 00000100:00100000:2.0:1787756443.774540:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afa7fc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bcdd3d25-193d-42cb-911a-069eb2969705+5:0:x1874598264059648:12345-192.168.203.21@tcp:2:touch.500 Request processed in 48822us (49002us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787756443.774552:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 13 00000100:00100000:0.0:1787756443.779222:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756443.782181:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264059904 00000100:00100000:1.0:1787756443.782195:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264059904 00000100:00100000:1.0:1787756443.782290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:1.0:1787756443.782300:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+10:9869:x1874598264059904:12345-192.168.203.21@tcp:35:touch.500 00000100:00100000:1.0:1787756443.783478:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+11:9869:x1874598264059904:12345-192.168.203.21@tcp:35:touch.500 Request processed in 1146us (4231us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787756443.783503:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00010000:00010000:0.0:1787756443.800083:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756443.801644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756443.801719:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264060032 00000100:00100000:2.0:1787756443.801728:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264060032 00000100:00100000:2.0:1787756443.801791:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:2.0:1787756443.801802:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+11:9870:x1874598264060032:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:2.0:1787756443.801826:0:8218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756443.801879:0:8218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab292 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a68 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.801945:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab299 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.801978:0:8218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.801990:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787756443.802065:0:8218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787756443.802070:0:8218:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787756443.802121:0:8218:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.802150:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab292 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a68 expref: 13 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.802168:0:8218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a68 expref: 12 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.802176:0:8218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98afa5da7c00) 00010000:00010000:2.0:1787756443.802178:0:8218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787756443.802181:0:8218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2044800, rc 0) 00000100:00100000:2.0:1787756443.802231:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+12:9870:x1874598264060032:12345-192.168.203.21@tcp:101:rm.0 Request processed in 431us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756443.802239:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 21 00000100:00100000:2.0:1787756443.811265:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756443.813727:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264060288 00000100:00100000:3.0:1787756443.813740:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264060288 00000100:00100000:2.0:1787756443.815924:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:2.0:1787756443.815938:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+12:9870:x1874598264060288:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:2.0:1787756443.815960:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756443.815993:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a6f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787756443.816116:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787756443.816269:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a6f expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.816283:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af85ff0f00) 00010000:00010000:2.0:1787756443.816285:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787756443.816290:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a6f expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.816303:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2045e00, rc 0) 00000100:00100000:2.0:1787756443.816373:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+13:9870:x1874598264060288:12345-192.168.203.21@tcp:101:rm.0 Request processed in 439us (5118us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787756443.816380:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 22 00000100:00100000:0.0:1787756443.820942:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756443.821064:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264060416 00000100:00100000:2.0:1787756443.821074:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264060416 00000100:00100000:2.0:1787756443.821133:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:2.0:1787756443.821143:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfceed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcdd3d25-193d-42cb-911a-069eb2969705+13:9870:x1874598264060416:12345-192.168.203.21@tcp:37:rm.0 00000100:00100000:2.0:1787756443.826310:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfceed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcdd3d25-193d-42cb-911a-069eb2969705+13:9870:x1874598264060416:12345-192.168.203.21@tcp:37:rm.0 Request processed in 5158us (5366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756443.826323:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:3.0:1787756443.833795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756443.833921:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264060672 00000100:00100000:1.0:1787756443.833943:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264060672 00000100:00100000:1.0:1787756443.834004:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:1.0:1787756443.834014:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+13:9870:x1874598264060672:12345-192.168.203.21@tcp:35:rm.0 00000100:00100000:1.0:1787756443.834283:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+14:9870:x1874598264060672:12345-192.168.203.21@tcp:35:rm.0 Request processed in 269us (499us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787756443.834291:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:0.0:1787756443.838565:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756443.838875:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264060928 00000100:00100000:2.0:1787756443.838903:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264060928 00000100:00100000:2.0:1787756443.839015:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:2.0:1787756443.839026:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+14:9870:x1874598264060928:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:2.0:1787756443.839092:0:8218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756443.839112:0:8218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a76 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.839343:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab2b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.839358:0:8218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab2b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.839370:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab2b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787756443.839381:0:8218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787756443.839630:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a76 expref: 17 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.839649:0:8218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab2b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a76 expref: 16 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.839658:0:8218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98afa5da7c00) 00010000:00010000:2.0:1787756443.839662:0:8218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787756443.839665:0:8218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2044c00, rc 0) 00000100:00100000:2.0:1787756443.839986:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+16:9870:x1874598264060928:12345-192.168.203.21@tcp:101:rm.0 Request processed in 960us (1428us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787756443.839994:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 23 00000100:00100000:1.0:1787756443.843265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756443.843354:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264061056 00000100:00100000:0.0:1787756443.843362:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264061056 00000100:00100000:0.0:1787756443.843431:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:0.0:1787756443.843440:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+16:9870:x1874598264061056:12345-192.168.203.21@tcp:41:rm.0 00000004:00000024:0.0:1787756443.843495:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787756443.843571:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+16:9870:x1874598264061056:12345-192.168.203.21@tcp:41:rm.0 Request processed in 132us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756443.843579:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 24 00000100:00100000:3.0:1787756443.845797:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756443.845944:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264061184 00000100:00100000:1.0:1787756443.845953:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264061184 00000100:00100000:1.0:1787756443.846052:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:1.0:1787756443.846062:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+16:9870:x1874598264061184:12345-192.168.203.21@tcp:101:rm.0 00010000:00010000:1.0:1787756443.846079:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787756443.846097:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844400/0x178386880caab2c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846176:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844a00/0x178386880caab2ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846189:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844a00/0x178386880caab2ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846213:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844a00/0x178386880caab2ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846248:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844e00/0x178386880caab2d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846256:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844e00/0x178386880caab2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846281:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844e00/0x178386880caab2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846577:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845400/0x178386880caab2d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846630:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845400/0x178386880caab2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846645:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845400/0x178386880caab2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787756443.846752:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787756443.846757:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787756443.846791:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845400/0x178386880caab2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846819:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845400/0x178386880caab2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846828:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844a00/0x178386880caab2ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.846995:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844a00/0x178386880caab2ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847002:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844a00/0x178386880caab2ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847008:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afb3844a00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:1.0:1787756443.847012:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844a00/0x178386880caab2ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847050:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844a00/0x178386880caab2ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847082:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98afa5da7c00) 00010000:00010000:1.0:1787756443.847085:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787756443.847090:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844a00/0x178386880caab2ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847097:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844a00/0x178386880caab2ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847150:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844e00/0x178386880caab2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847304:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844e00/0x178386880caab2d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847312:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844e00/0x178386880caab2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847317:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afb3844e00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:1.0:1787756443.847320:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844e00/0x178386880caab2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847326:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844e00/0x178386880caab2d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847334:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x65d33690 (ffff98afa5da7400) 00010000:00010000:1.0:1787756443.847336:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787756443.847339:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844e00/0x178386880caab2d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847355:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844e00/0x178386880caab2d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847669:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844400/0x178386880caab2c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a7d expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847716:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845400/0x178386880caab2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a7d expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.847725:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98afa0b08e00) 00010000:00010000:1.0:1787756443.847727:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787756443.847730:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afb3845400, rc 0) 00000100:00100000:1.0:1787756443.847881:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+17:9870:x1874598264061184:12345-192.168.203.21@tcp:101:rm.0 Request processed in 1819us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756443.847890:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 25 00000100:00100000:3.0:1787756443.851127:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756443.851229:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264061440 00000100:00100000:0.0:1787756443.851238:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264061440 00000100:00100000:0.0:1787756443.851294:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 26 00000100:00100000:0.0:1787756443.851303:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+17:9870:x1874598264061440:12345-192.168.203.21@tcp:36:rm.0 00010000:00010000:0.0:1787756443.851355:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787756443.851381:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3845400/0x178386880caab2d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a7d expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.851413:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a61 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.851441:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98afa0b08e00) 00010000:00010000:0.0:1787756443.851458:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab299 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a68 expref: 15 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.851467:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98afa5da7c00) 00010000:00010000:0.0:1787756443.851470:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787756443.851489:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab2df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.851501:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab2df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.851510:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab2df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.851523:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab2e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.851530:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.851536:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.851680:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab2ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.851689:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab2ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.851706:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab2ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787756443.852742:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787756443.852756:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302740921911ns, next at 303740919313ns, rc = 0 00010000:00010000:0.0:1787756443.852817:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab2f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.852829:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.852882:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.852906:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab2f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.852913:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab2f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.852920:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.852954:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787756443.853006:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab2ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853013:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab2ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853049:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab2ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853064:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81542000 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:0.0:1787756443.853069:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab2ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853077:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab2ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853089:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98afa0b08600) 00010000:00010000:0.0:1787756443.853092:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787756443.853097:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab2ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853103:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab2ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853158:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab2df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853172:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab2df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853187:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab2df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853192:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81543e00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:0.0:1787756443.853195:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab2df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853206:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab2df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853243:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98afa5da7c00) 00010000:00010000:0.0:1787756443.853246:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787756443.853249:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab2df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.853254:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab2df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787756443.853278:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081083f8b reply state 000000004358a706 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756443.853286:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787756443.853428:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+16:9870:x1874598264061440:12345-192.168.203.21@tcp:36:rm.0 Request processed in 2122us (2306us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787756443.853437:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 26 00010000:00010000:3.0:1787756443.853887:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787756443.853895:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab2f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.853902:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81543800 already unused, calling callback (ffffffffc162d530) 00010000:00010000:3.0:1787756443.853906:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab2f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.853912:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.853923:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff98afa0b08600) 00010000:00010000:3.0:1787756443.853925:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787756443.853928:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab2f4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.853933:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab2f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756443.853948:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756443.853950:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756443.853952:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756443.857730:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.857766:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab2e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.857774:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab2e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.857780:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81543a00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:0.0:1787756443.857797:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab2e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.857805:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab2e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.857896:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x65d33690 (ffff98afa0b08100) 00010000:00010000:0.0:1787756443.857908:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787756443.857913:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab2e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.857919:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab2e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x65d33690 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756443.861271:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756443.861763:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264061696 00000100:00100000:1.0:1787756443.861773:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264061696 00000100:00100000:1.0:1787756443.861820:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:1.0:1787756443.861828:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af917f0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+15:9870:x1874598264061696:12345-192.168.203.21@tcp:35:rm.0 00000100:00100000:1.0:1787756443.862104:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af917f0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+16:9870:x1874598264061696:12345-192.168.203.21@tcp:35:rm.0 Request processed in 276us (842us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787756443.862112:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:3.0:1787756443.865771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756443.865993:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264061952 00000100:00100000:2.0:1787756443.866004:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264061952 00000100:00100000:2.0:1787756443.866142:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 27 00000100:00100000:2.0:1787756443.866181:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+16:9870:x1874598264061952:12345-192.168.203.21@tcp:36:rm.0 00010000:00010000:2.0:1787756443.866291:0:8218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787756443.866331:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab2b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a76 expref: 16 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.866369:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afb3844c00/0x178386880caab253 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a53 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.866379:0:8218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98afa5da7c00) 00010000:00010000:2.0:1787756443.866429:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7200/0x178386880caab214 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a45 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.866438:0:8218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af85ff0f00) 00010000:00010000:2.0:1787756443.866460:0:8218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787756443.866482:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.866509:0:8218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.866520:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.866531:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab302 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.866553:0:8218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab302 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.866561:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab302 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.867145:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab309 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.867168:0:8218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.867175:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787756443.868308:0:8218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787756443.868327:0:8218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab309 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868336:0:8218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab309 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868343:0:8218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab309 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868350:0:8218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2044800 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:2.0:1787756443.868355:0:8218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab309 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868363:0:8218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab309 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868375:0:8218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff98af8995f500) 00010000:00010000:2.0:1787756443.868379:0:8218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787756443.868383:0:8218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab309 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868399:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab309 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868423:0:8218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868430:0:8218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868436:0:8218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868441:0:8218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2045e00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:2.0:1787756443.868444:0:8218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868450:0:8218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868458:0:8218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af8995f700) 00010000:00010000:2.0:1787756443.868461:0:8218:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787756443.868469:0:8218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756443.868475:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab2fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787756443.868488:0:8218:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000186a5141 reply state 00000000f0481cbd transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab302 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756443.868497:0:8218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787756443.868586:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+15:9870:x1874598264061952:12345-192.168.203.21@tcp:36:rm.0 Request processed in 2419us (2845us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787756443.868593:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 27 00010000:00010000:1.0:1787756443.871713:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab302 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.871732:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab302 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.871756:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab302 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.871763:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2045200 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:1.0:1787756443.871768:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab302 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.871776:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab302 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.871793:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff98af8995fd00) 00010000:00010000:1.0:1787756443.871796:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787756443.871801:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab302 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756443.871808:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045200/0x178386880caab302 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756443.906188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756443.906580:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264062080 00000100:00100000:0.0:1787756443.906592:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264062080 00000100:00100000:0.0:1787756443.906653:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:0.0:1787756443.906662:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfc6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+14:9873:x1874598264062080:12345-192.168.203.21@tcp:101:getfattr.0 00010000:00010000:0.0:1787756443.906686:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756443.906719:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab310 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a84 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.906785:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab317 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.906799:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.906809:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787756443.906901:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787756443.906906:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787756443.906948:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.906990:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab310 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a84 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.907008:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a84 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756443.907016:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08100) 00010000:00010000:0.0:1787756443.907019:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787756443.907022:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af81543e00, rc 0) 00000100:00100000:0.0:1787756443.907092:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfc6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+15:9873:x1874598264062080:12345-192.168.203.21@tcp:101:getfattr.0 Request processed in 431us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756443.907098:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 28 00000100:00100000:3.0:1787756443.916254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756443.916482:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264062208 00000100:00100000:1.0:1787756443.916492:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264062208 00000100:00100000:1.0:1787756443.916556:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:1.0:1787756443.916567:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+15:9873:x1874598264062208:12345-192.168.203.21@tcp:33:getfattr.0 00000004:00200000:1.0:1787756443.916666:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787756443.916671:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00100000:1.0:1787756443.916765:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+15:9873:x1874598264062208:12345-192.168.203.21@tcp:33:getfattr.0 Request processed in 200us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756443.916772:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:3.0:1787756444.008777:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756444.008882:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264062464 00000100:00100000:2.0:1787756444.008901:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264062464 00000100:00100000:2.0:1787756444.008960:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:2.0:1787756444.008970:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+15:9878:x1874598264062464:12345-192.168.203.21@tcp:36:lfs.0 00010000:00010000:2.0:1787756444.009020:0:8218:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787756444.009054:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab317 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a84 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756444.009071:0:8218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08100) 00010000:00010000:2.0:1787756444.009080:0:8218:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787756444.009101:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab31e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756444.009113:0:8218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab31e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756444.009122:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab31e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787756444.009339:0:8218:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f13c28a reply state 00000000735d4f97 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab31e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756444.009349:0:8218:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787756444.009362:0:8218:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787756444.009461:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bcdd3d25-193d-42cb-911a-069eb2969705+16:9878:x1874598264062464:12345-192.168.203.21@tcp:36:lfs.0 Request processed in 492us (693us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787756444.009468:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00010000:00010000:0.0:1787756444.010992:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab31e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.011007:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab31e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.011014:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab31e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.011021:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2045e00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:0.0:1787756444.011025:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab31e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.011045:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab31e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.011060:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af8995f700) 00010000:00010000:0.0:1787756444.011074:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787756444.011079:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab31e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.011085:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab31e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8218 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756444.022104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756444.022215:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264062592 00000100:00100000:0.0:1787756444.022224:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264062592 00000100:00100000:0.0:1787756444.022282:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:0.0:1787756444.022292:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+15:9879:x1874598264062592:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787756444.022315:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756444.022340:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a8b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.022405:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab32c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.022419:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.022637:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787756444.022696:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787756444.022700:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787756444.022735:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.022761:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a8b expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.022924:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab32c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a8b expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756444.022934:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08e00) 00010000:00010000:0.0:1787756444.022937:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787756444.022940:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af81542000, rc 0) 00000100:00100000:0.0:1787756444.023050:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+16:9879:x1874598264062592:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 758us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756444.023058:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 30 00000100:00100000:3.0:1787756444.026530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756444.026672:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264062720 00000100:00100000:2.0:1787756444.026682:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264062720 00000100:00100000:2.0:1787756444.027168:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:2.0:1787756444.027180:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae81ba5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcdd3d25-193d-42cb-911a-069eb2969705+16:9879:x1874598264062720:12345-192.168.203.21@tcp:33:lfs.0 00000004:00200000:2.0:1787756444.027274:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787756444.027280:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00100000:2.0:1787756444.027368:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae81ba5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bcdd3d25-193d-42cb-911a-069eb2969705+16:9879:x1874598264062720:12345-192.168.203.21@tcp:33:lfs.0 Request processed in 190us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756444.027376:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00010000:00010000:0.0:1787756444.824755:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787756445.851196:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787756445.925476:0:11665:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-compr test 2001: All chunks are compressed ===== 11:00:44 (1787756444) 00010000:00010000:0.0:1787756446.873363:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787756447.257514:0:7074:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306145678516ns, next at 307145676239ns, rc = 0 00000100:00100000:0.0:1787756447.257559:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfcee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287166080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787756447.257628:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756447.257711:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287166080 00000100:00100000:0.0:1787756447.257717:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287166080 00000100:00100000:0.0:1787756447.257797:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787756447.257806:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287166080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787756447.257857:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756447.257914:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874598287166080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756447.257921:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787756447.257944:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787756447.257973:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfcee940 x1874598287166080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756447.258019:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfcee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1874598287166080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787756447.263544:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287166336:0@lo:400:kworker.0 00000100:00100000:3.0:1787756447.264746:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756447.264816:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787756447.264825:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287166464:0@lo:400:kworker.0 00000100:00100000:3.0:1787756447.264877:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787756447.264916:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287166336 00000100:00100000:3.0:1787756447.264923:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287166336 00000100:00100000:3.0:1787756447.264963:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287166464 00000100:00100000:3.0:1787756447.264967:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287166464 00000100:00100000:3.0:1787756447.264992:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787756447.265000:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287166336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756447.265064:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874598287166336:12345-0@lo:400:kworker.0 Request processed in 65us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756447.265071:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787756447.265088:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787756447.265094:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287166464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756447.265120:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa62940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874598287166464:12345-0@lo:400:kworker.0 Request processed in 26us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756447.265125:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787756447.265395:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa61e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1874598287166464:0@lo:400:kworker.0 00000100:00100000:3.0:1787756447.265413:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa62d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874598287166336:0@lo:400:kworker.0 00000100:00100000:0.0:1787756447.265581:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287166208:0@lo:400:kworker.0 00000100:00100000:0.0:1787756447.265632:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756447.265663:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287166720:0@lo:400:kworker.0 00000100:00100000:0.0:1787756447.265698:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756447.265719:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787756447.265726:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287166592:0@lo:400:kworker.0 00000100:00100000:0.0:1787756447.265746:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787756447.265775:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787756447.265786:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287166592 00000100:00100000:0.0:1787756447.265790:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287166592 00000100:00100000:0.0:1787756447.265821:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787756447.265828:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287166592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756447.265879:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfced680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874598287166592:12345-0@lo:400:kworker.0 Request processed in 51us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756447.265885:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787756447.265904:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287166720 00000100:00100000:0.0:1787756447.265908:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287166720 00000100:00100000:0.0:1787756447.265934:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787756447.265941:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfcee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287166720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787756447.265969:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfcee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874598287166720:12345-0@lo:400:kworker.0 Request processed in 29us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756447.265975:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787756447.265989:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787756447.265991:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787756447.266027:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1874598287166592:0@lo:400:kworker.0 00010000:00080000:0.0:1787756447.266039:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afbfa60f00 x1874598287166720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787756463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787756447.266048:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa60f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1874598287166720:0@lo:400:kworker.0 00000100:00100000:3.0:1787756447.267962:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287166208 00000100:00100000:3.0:1787756447.267974:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287166208 00000100:00100000:3.0:1787756447.268048:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787756447.268059:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287166208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787756447.268149:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccd9768b-6c21-4ce9-98b3-53472f28cbb6+19:3312:x1874598287166208:12345-0@lo:400:kworker.0 Request processed in 81us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756447.268156:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787756447.268809:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccd9768b-6c21-4ce9-98b3-53472f28cbb6:3312:1874598287166208:0@lo:400:kworker.0 00000100:00100000:0.0:1787756447.771001:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afb3c752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287166848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787756447.771081:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756447.771157:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287166848 00000100:00100000:0.0:1787756447.771165:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287166848 00000100:00100000:0.0:1787756447.771458:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787756447.771469:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287166848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787756447.771499:0:6695:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787756447.771546:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287166848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756447.771553:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787756447.771608:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff98afb3c752c0 x1874598287166848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787756463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787756447.771627:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afb3c752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287166848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787756447.838306:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756447.838375:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264062848 00000100:00100000:2.0:1787756447.838386:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264062848 00000100:00100000:2.0:1787756447.838462:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:2.0:1787756447.838473:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+16:10083:x1874598264062848:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:2.0:1787756447.838494:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756447.838512:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab333 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a92 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838571:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab33a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787756447.838572:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787756447.838585:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab33a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838599:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab33a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838654:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab341 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838662:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab341 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838669:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab341 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838732:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab33a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838739:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab33a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838746:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab33a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838752:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2044800 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:2.0:1787756447.838756:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab33a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838763:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab33a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838774:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08e00) 00010000:00010000:2.0:1787756447.838777:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787756447.838781:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab33a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838798:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044800/0x178386880caab33a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838816:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab341 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838822:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab341 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838827:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab341 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838846:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98afc2045e00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:2.0:1787756447.838850:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab341 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838857:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab341 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838867:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf3c05c3 (ffff98af8995f500) 00010000:00010000:2.0:1787756447.838870:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787756447.838873:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab341 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838879:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab341 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838912:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab333 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a92 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838921:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08e00) 00010000:00010000:2.0:1787756447.838924:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787756447.838934:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2044c00/0x178386880caab333 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a92 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.838944:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2044c00, rc 0) 00000100:00100000:2.0:1787756447.838995:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa62d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+16:10083:x1874598264062848:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 525us (710us total) trans 0 rc 301/301 00000100:00100000:2.0:1787756447.839014:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 31 00000100:00100000:3.0:1787756447.844081:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756447.846898:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264063104 00000100:00100000:0.0:1787756447.846913:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264063104 00000100:00100000:0.0:1787756447.846980:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:0.0:1787756447.846991:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+16:10083:x1874598264063104:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:0.0:1787756447.847024:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756447.847028:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787756447.847055:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81542000/0x178386880caab32c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a8b expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.847072:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08e00) 00010000:00010000:0.0:1787756447.847092:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787756447.847108:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab348 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6a99 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.847224:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab34f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.847237:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab34f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.847246:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab34f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.847258:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab356 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.847264:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab356 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.847270:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab356 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.848325:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab35d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.848339:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab35d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.848347:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab35d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787756447.848356:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00010000:00010000:0.0:1787756447.848381:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab34f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.848394:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab34f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.848400:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab34f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.848405:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81543e00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:0.0:1787756447.848409:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab34f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.848417:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab34f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.848426:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08800) 00010000:00010000:0.0:1787756447.848429:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787756447.848434:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab34f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.848439:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab34f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787756447.848451:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059008fd9 reply state 000000009ccc84c3 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab356 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756447.848459:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787756447.848488:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab348 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a99 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.848505:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab35d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a99 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.848526:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98afa0b08200) 00010000:00010000:0.0:1787756447.848528:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787756447.848531:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af81543c00, rc 0) 00000100:00100000:0.0:1787756447.848613:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa61e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+18:10083:x1874598264063104:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 1624us (4541us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787756447.848621:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 32 00000100:00100000:3.0:1787756447.853135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756447.853187:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264063360 00000100:00100000:3.0:1787756447.853196:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264063360 00010000:00010000:1.0:1787756447.853235:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab356 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756447.853248:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab356 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756447.853257:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab356 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756447.853259:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 33 00010000:00010000:1.0:1787756447.853269:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81543800 already unused, calling callback (ffffffffc20814f0) 00000100:00100000:3.0:1787756447.853275:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+18:10083:x1874598264063360:12345-192.168.203.21@tcp:101:lfs.0 00010000:00010000:1.0:1787756447.853276:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab356 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756447.853289:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab356 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787756447.853305:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf3c05c3 (ffff98afa0b08c00) 00010000:00010000:1.0:1787756447.853308:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787756447.853314:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab356 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.853314:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787756447.853323:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543800/0x178386880caab356 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.853337:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab36b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6aa0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.853439:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.853453:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab35d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a99 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.853462:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.853502:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab35d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a99 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.853517:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab35d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a99 expref: 18 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756447.853532:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfa630c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874598287166976:192.168.203.21@tcp:104: 00000100:00100000:3.0:1787756447.853946:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff98af90c50d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787756447.856507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756447.856611:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264063488 00000100:00100000:0.0:1787756447.856619:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264063488 00010000:00010000:0.0:1787756447.856655:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab35d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a99 expref: 19 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787756447.856706:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 29 00000100:00100000:0.0:1787756447.856717:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afb3c752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcdd3d25-193d-42cb-911a-069eb2969705+19:2366:x1874598264063488:12345-192.168.203.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787756447.856730:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787756447.856737:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab35d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a99 expref: 19 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.856749:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab35d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a99 expref: 19 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.856768:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98afa0b08200) 00010000:00010000:0.0:1787756447.856774:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.856783:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.856802:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.856820:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787756447.856903:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afb3c752c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bcdd3d25-193d-42cb-911a-069eb2969705+19:2366:x1874598264063488:12345-192.168.203.21@tcp:103:ldlm_bl.0 Request processed in 187us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756447.856911:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 29 00010000:00010000:3.0:1787756447.857564:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543c00/0x178386880caab35d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6a99 expref: 18 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756447.857581:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfa630c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1874598287166976:192.168.203.21@tcp:104: 00010000:00010000:3.0:1787756447.857600:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.857608:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.857613:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787756447.857631:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00000004:00080000:3.0:1787756447.857964:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787756447.858089:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.858097:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.858112:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.858118:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af84da6000 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:3.0:1787756447.858122:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.858130:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.858141:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98afa0b08200) 00010000:00010000:3.0:1787756447.858145:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787756447.858149:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.858155:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab372 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.858278:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab36b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6aa0 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.858288:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af85ff0000) 00010000:00010000:3.0:1787756447.858290:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787756447.858294:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab36b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6aa0 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.858306:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7600, rc 0) 00000100:00100000:3.0:1787756447.858345:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa60780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+17:10083:x1874598264063360:12345-192.168.203.21@tcp:101:lfs.0 Request processed in 5074us (5219us total) trans 4294967311 rc 301/301 00000100:00100000:3.0:1787756447.858362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 33 00000100:00100000:0.0:1787756447.867252:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756447.867315:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264063744 00000100:00100000:2.0:1787756447.867325:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264063744 00000100:00100000:2.0:1787756447.867388:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:2.0:1787756447.867399:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+17:10083:x1874598264063744:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:2.0:1787756447.867761:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+18:10083:x1874598264063744:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 362us (514us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787756447.867780:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:2.0:1787756447.869762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756447.869874:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264064000 00000100:00100000:3.0:1787756447.869882:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264064000 00000100:00100000:3.0:1787756447.869930:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1787756447.869941:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+18:10083:x1874598264064000:12345-192.168.203.21@tcp:35:lfs.0 00000100:00100000:3.0:1787756447.870155:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bcdd3d25-193d-42cb-911a-069eb2969705+19:10083:x1874598264064000:12345-192.168.203.21@tcp:35:lfs.0 Request processed in 215us (399us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787756447.870163:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:3.0:1787756447.886782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756447.887065:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264064128 00000100:00100000:0.0:1787756447.887074:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264064128 00000100:00100000:0.0:1787756447.887117:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:0.0:1787756447.887125:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+19:10084:x1874598264064128:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:0.0:1787756447.887148:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787756447.887170:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab380 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6aa7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.887239:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab387 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.887252:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.887262:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787756447.887319:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787756447.887324:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787756447.887370:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.887406:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543a00/0x178386880caab380 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6aa7 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.887436:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab387 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6aa7 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.887445:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08800) 00010000:00010000:0.0:1787756447.887447:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787756447.887452:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af81543e00, rc 0) 00000100:00100000:0.0:1787756447.887518:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+20:10084:x1874598264064128:12345-192.168.203.21@tcp:101:dd.0 Request processed in 393us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787756447.887525:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 34 00000100:00100000:1.0:1787756447.893972:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756447.894058:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264064384 00000100:00100000:3.0:1787756447.894067:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264064384 00000100:00100000:3.0:1787756447.894118:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 35 00000100:00100000:3.0:1787756447.894128:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfceed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+20:10084:x1874598264064384:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:3.0:1787756447.894148:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756447.894151:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787756447.894242:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af81543e00/0x178386880caab387 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6aa7 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894258:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98afa0b08800) 00010000:00010000:3.0:1787756447.894269:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787756447.894284:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7200/0x178386880caab38e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6aae expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894562:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab395 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894586:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab395 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894596:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab395 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894611:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab39c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894617:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab39c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894624:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab39c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894711:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab3a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894720:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894727:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787756447.894736:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 0 00010000:00010000:3.0:1787756447.894826:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab395 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894859:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab395 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894866:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab395 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894879:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af84da7600 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:3.0:1787756447.894883:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab395 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894891:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab395 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894901:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff98af85ff0000) 00010000:00010000:3.0:1787756447.894904:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787756447.894908:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab395 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894914:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7600/0x178386880caab395 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894924:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab39c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894929:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab39c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894936:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab39c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894941:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af84da6000 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:3.0:1787756447.894944:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab39c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894950:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab39c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894967:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdf3c05c3 (ffff98af85ff0b00) 00010000:00010000:3.0:1787756447.894969:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787756447.894973:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab39c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.894979:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6000/0x178386880caab39c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdf3c05c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.895032:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7200/0x178386880caab38e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6aae expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.895047:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6aae expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.895055:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98af85ff0200) 00010000:00010000:3.0:1787756447.895057:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787756447.895060:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7400, rc 0) 00000100:00100000:3.0:1787756447.895120:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfceed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bcdd3d25-193d-42cb-911a-069eb2969705+21:10084:x1874598264064384:12345-192.168.203.21@tcp:101:dd.0 Request processed in 992us (1157us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787756447.895128:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 35 00010000:00010000:3.0:1787756447.896185:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787756447.904661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756447.904732:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264064640 00000100:00100000:3.0:1787756447.904742:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264064640 00000100:00100000:3.0:1787756447.904800:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 36 00000100:00100000:3.0:1787756447.904809:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98ae84728780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+21:10084:x1874598264064640:12345-192.168.203.21@tcp:36:dd.0 00010000:00010000:3.0:1787756447.904895:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787756447.904921:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da7400/0x178386880caab3a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6aae expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.904944:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98af85ff0200) 00010000:00010000:3.0:1787756447.904955:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787756447.905189:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab3b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.905203:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.905214:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787756447.905269:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967315 00000004:00010000:3.0:1787756447.905307:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d19d52d8 reply state 00000000583630a7 transno 4294967316 ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756447.905316:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787756447.905417:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98ae84728780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bcdd3d25-193d-42cb-911a-069eb2969705+23:10084:x1874598264064640:12345-192.168.203.21@tcp:36:dd.0 Request processed in 608us (764us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787756447.905435:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 36 00000020:00080000:3.0:1787756447.905440:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787756447.908493:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.908510:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab3b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.908517:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787756447.908522:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00010000:00010000:0.0:1787756447.908524:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af84da6c00 already unused, calling callback (ffffffffc20814f0) 00010000:00010000:0.0:1787756447.908529:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.908537:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab3b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756447.908554:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98af85ff0a00) 00010000:00010000:0.0:1787756447.908569:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787756447.908572:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264064768 00010000:00010000:0.0:1787756447.908576:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab3b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756447.908582:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264064768 00010000:00010000:0.0:1787756447.908585:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff98af84da6c00/0x178386880caab3b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787756447.908636:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:2.0:1787756447.908645:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+22:10084:x1874598264064768:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:2.0:1787756447.908670:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787756447.908699:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab3b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6ab5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.908758:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab3b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6ab5 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.908778:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff98afc2045e00/0x178386880caab3b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6ab5 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787756447.908806:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff98af8995f500) 00010000:00010000:2.0:1787756447.908809:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787756447.908812:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98afc2045e00, rc 0) 00000100:00100000:2.0:1787756447.908992:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa63840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bcdd3d25-193d-42cb-911a-069eb2969705+23:10084:x1874598264064768:12345-192.168.203.21@tcp:101:dd.0 Request processed in 345us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787756447.909000:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 37 00000100:00100000:0.0:1787756447.913090:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756447.913128:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264064896 00000100:00100000:3.0:1787756447.913136:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264064896 00000100:00080000:0.0:1787756447.913187:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787756447.913216:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:3.0:1787756447.913227:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcdd3d25-193d-42cb-911a-069eb2969705+5:10084:x1874598264064896:12345-192.168.203.21@tcp:101:dd.0 00010000:00010000:3.0:1787756447.913245:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787756447.913268:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db543b2c/0x178386880caab3bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdfd80640ddaa6abc expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787756447.913306:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787756447.913326:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=306s v=(0 0) 00010000:00010000:3.0:1787756447.913330:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787756447.913339:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db543b2c/0x178386880caab3bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6abc expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.913354:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db543b2c/0x178386880caab3bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.21@tcp remote: 0xdfd80640ddaa6abc expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787756447.913365:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff98af84da7200, rc 0) 00000100:00100000:3.0:1787756447.913424:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bcdd3d25-193d-42cb-911a-069eb2969705+6:10084:x1874598264064896:12345-192.168.203.21@tcp:101:dd.0 Request processed in 200us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787756447.913431:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 14 00000100:00100000:3.0:1787756447.915463:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756447.915541:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264065024 00000100:00100000:0.0:1787756447.915551:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264065024 00002000:00010000:0.0:1787756447.915586:0:6696:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787756447.915591:0:6696:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa60b40 with x1874598264065024 ext(0->18446744073709551615) 00002000:00010000:0.0:1787756447.915602:0:6696:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa60b40. 00000100:00100000:0.0:1787756447.915637:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 0 00000100:00100000:0.0:1787756447.915646:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcdd3d25-193d-42cb-911a-069eb2969705+6:2365:x1874598264065024:12345-192.168.203.21@tcp:10:dd.0 00002000:00010000:0.0:1787756447.916115:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787756447.916119:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787756448 00002000:00010000:0.0:1787756447.916122:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787756447.916124:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787756448 00002000:00010000:0.0:1787756447.916126:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787756447.916187:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa60b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcdd3d25-193d-42cb-911a-069eb2969705+7:2365:x1874598264065024:12345-192.168.203.21@tcp:10:dd.0 Request processed in 541us (733us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787756447.916196:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 0 00002000:00010000:0.0:1787756447.916199:0:6696:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787756447.916202:0:6696:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa60b40 with x1874598264065024 ext(0->18446744073709551615) 00002000:00010000:0.0:1787756447.916207:0:6696:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa60b40. 00000100:00100000:0.0:1787756448.084927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756448.085082:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264065152 00000100:00100000:1.0:1787756448.085091:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264065152 00002000:00100000:1.0:1787756448.085137:0:6698:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->528383) req@ffff98afbfca3840 x1874598264065152/t0(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/0 e 0 to 0 dl 1787756459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787756448.085157:0:6698:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfca3840 with x1874598264065152 ext(0->528383) 00002000:00010000:1.0:1787756448.085163:0:6698:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfca3840 00000100:00100000:1.0:1787756448.085204:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 1 00000100:00100000:1.0:1787756448.085213:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcdd3d25-193d-42cb-911a-069eb2969705+7:2363:x1874598264065152:12345-192.168.203.21@tcp:4:dd.0 00000100:00100000:1.0:1787756448.092355:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcdd3d25-193d-42cb-911a-069eb2969705+9:2363:x1874598264065152:12345-192.168.203.21@tcp:4:dd.0 Request processed in 7134us (7429us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787756448.092367:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 1 00002000:00100000:1.0:1787756448.092378:0:6698:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->528383) req@ffff98afbfca3840 x1874598264065152/t4294967301(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/448 e 0 to 0 dl 1787756459 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787756448.092387:0:6698:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfca3840 with x1874598264065152 ext(0->528383) 00002000:00010000:1.0:1787756448.092393:0:6698:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfca3840 00000100:00100000:3.0:1787756448.153441:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756448.153542:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264065280 00000100:00100000:0.0:1787756448.153551:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264065280 00002000:00100000:0.0:1787756448.153599:0:6696:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (1048576->1576959) req@ffff98afbfa61680 x1874598264065280/t0(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/0 e 0 to 0 dl 1787756459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787756448.153609:0:6696:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa61680 with x1874598264065280 ext(1048576->1576959) 00002000:00010000:0.0:1787756448.153615:0:6696:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa61680 00000100:00100000:0.0:1787756448.153650:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 2 00000100:00100000:0.0:1787756448.153660:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcdd3d25-193d-42cb-911a-069eb2969705+9:2364:x1874598264065280:12345-192.168.203.21@tcp:4:dd.0 00000100:00100000:1.0:1787756448.159677:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa61680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcdd3d25-193d-42cb-911a-069eb2969705+11:2364:x1874598264065280:12345-192.168.203.21@tcp:4:dd.0 Request processed in 6009us (6234us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787756448.159701:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 2 00002000:00100000:1.0:1787756448.159713:0:6696:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (1048576->1576959) req@ffff98afbfa61680 x1874598264065280/t4294967302(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/448 e 0 to 0 dl 1787756459 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787756448.159724:0:6696:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa61680 with x1874598264065280 ext(1048576->1576959) 00002000:00010000:1.0:1787756448.159730:0:6696:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa61680 00000100:00100000:3.0:1787756448.204151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756448.204313:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264065408 00000100:00100000:1.0:1787756448.204330:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264065408 00002000:00100000:1.0:1787756448.204400:0:6698:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (2097152->2625535) req@ffff98afbfa61a40 x1874598264065408/t0(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/0 e 0 to 0 dl 1787756459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787756448.204411:0:6698:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa61a40 with x1874598264065408 ext(2097152->2625535) 00002000:00010000:1.0:1787756448.204520:0:6698:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa61a40 00000100:00100000:1.0:1787756448.204571:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 3 00000100:00100000:1.0:1787756448.204582:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcdd3d25-193d-42cb-911a-069eb2969705+11:2363:x1874598264065408:12345-192.168.203.21@tcp:4:dd.0 00000100:00100000:1.0:1787756448.207397:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa61a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcdd3d25-193d-42cb-911a-069eb2969705+13:2363:x1874598264065408:12345-192.168.203.21@tcp:4:dd.0 Request processed in 2807us (3246us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787756448.207411:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 3 00002000:00100000:1.0:1787756448.207422:0:6698:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (2097152->2625535) req@ffff98afbfa61a40 x1874598264065408/t4294967303(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/448 e 0 to 0 dl 1787756459 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787756448.207431:0:6698:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa61a40 with x1874598264065408 ext(2097152->2625535) 00002000:00010000:1.0:1787756448.207437:0:6698:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa61a40 00000100:00100000:0.0:1787756448.290822:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756448.294732:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264065536 00000100:00100000:1.0:1787756448.294748:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264065536 00002000:00100000:0.0:1787756448.299593:0:6696:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (3145728->3674111) req@ffff98afbfca0f00 x1874598264065536/t0(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/0 e 0 to 0 dl 1787756459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787756448.299608:0:6696:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfca0f00 with x1874598264065536 ext(3145728->3674111) 00002000:00010000:0.0:1787756448.299615:0:6696:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfca0f00 00000100:00100000:0.0:1787756448.299646:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 4 00000100:00100000:0.0:1787756448.299658:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfca0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcdd3d25-193d-42cb-911a-069eb2969705+13:2364:x1874598264065536:12345-192.168.203.21@tcp:4:dd.0 00000100:00100000:0.0:1787756448.302245:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfca0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcdd3d25-193d-42cb-911a-069eb2969705+15:2364:x1874598264065536:12345-192.168.203.21@tcp:4:dd.0 Request processed in 2580us (11421us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787756448.302259:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 4 00002000:00100000:0.0:1787756448.302270:0:6696:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (3145728->3674111) req@ffff98afbfca0f00 x1874598264065536/t4294967304(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/448 e 0 to 0 dl 1787756459 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787756448.302281:0:6696:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfca0f00 with x1874598264065536 ext(3145728->3674111) 00002000:00010000:0.0:1787756448.302288:0:6696:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfca0f00 00000100:00100000:3.0:1787756448.376990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756448.377097:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264065664 00000100:00100000:1.0:1787756448.377107:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264065664 00002000:00100000:1.0:1787756448.377156:0:6698:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (4194304->4722687) req@ffff98afbfa62580 x1874598264065664/t0(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/0 e 0 to 0 dl 1787756459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787756448.377166:0:6698:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa62580 with x1874598264065664 ext(4194304->4722687) 00002000:00010000:1.0:1787756448.377172:0:6698:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa62580 00000100:00100000:1.0:1787756448.377216:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 5 00000100:00100000:1.0:1787756448.377225:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcdd3d25-193d-42cb-911a-069eb2969705+15:2364:x1874598264065664:12345-192.168.203.21@tcp:4:dd.0 00000100:00100000:1.0:1787756448.381182:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa62580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcdd3d25-193d-42cb-911a-069eb2969705+17:2364:x1874598264065664:12345-192.168.203.21@tcp:4:dd.0 Request processed in 3940us (4184us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787756448.381195:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 5 00002000:00100000:1.0:1787756448.381208:0:6698:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (4194304->4722687) req@ffff98afbfa62580 x1874598264065664/t4294967305(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/448 e 0 to 0 dl 1787756459 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787756448.381230:0:6698:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa62580 with x1874598264065664 ext(4194304->4722687) 00002000:00010000:1.0:1787756448.381235:0:6698:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa62580 00000100:00100000:3.0:1787756448.682272:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:1.0:1787756448.683094:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264065792 00000100:00100000:1.0:1787756448.683105:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264065792 00000100:00100000:1.0:1787756448.683185:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 234 00000100:00100000:1.0:1787756448.683398:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98af86ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264065792:12345-192.168.203.21@tcp:400:kworker.0 00000100:00100000:1.0:1787756448.683471:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98af86ee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da773933-0c5c-4731-bbda-bf23609f1b54+10:2363:x1874598264065792:12345-192.168.203.21@tcp:400:kworker.0 Request processed in 77us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787756448.688854:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 234 00000100:00100000:3.0:1787756448.730979:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756448.731074:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264065920 00000100:00100000:0.0:1787756448.731086:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264065920 00002000:00100000:0.0:1787756448.731169:0:6696:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (5242880->5771263) req@ffff98afbfa603c0 x1874598264065920/t0(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/0 e 0 to 0 dl 1787756459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787756448.731180:0:6696:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa603c0 with x1874598264065920 ext(5242880->5771263) 00002000:00010000:0.0:1787756448.731186:0:6696:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa603c0 00000100:00100000:0.0:1787756448.732527:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 6 00000100:00100000:0.0:1787756448.732548:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcdd3d25-193d-42cb-911a-069eb2969705+17:2363:x1874598264065920:12345-192.168.203.21@tcp:4:dd.0 00000100:00100000:2.0:1787756448.741087:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa603c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcdd3d25-193d-42cb-911a-069eb2969705+19:2363:x1874598264065920:12345-192.168.203.21@tcp:4:dd.0 Request processed in 8538us (10118us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787756448.741104:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 6 00002000:00100000:2.0:1787756448.741115:0:6696:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (5242880->5771263) req@ffff98afbfa603c0 x1874598264065920/t4294967306(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/448 e 0 to 0 dl 1787756459 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787756448.741125:0:6696:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa603c0 with x1874598264065920 ext(5242880->5771263) 00002000:00010000:2.0:1787756448.741130:0:6696:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa603c0 00000100:00100000:2.0:1787756448.835447:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:3.0:1787756448.836740:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264066048 00000100:00100000:3.0:1787756448.836752:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264066048 00002000:00100000:3.0:1787756448.836803:0:6698:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (6291456->6819839) req@ffff98afbfa721c0 x1874598264066048/t0(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/0 e 0 to 0 dl 1787756459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787756448.836815:0:6698:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa721c0 with x1874598264066048 ext(6291456->6819839) 00002000:00010000:3.0:1787756448.836820:0:6698:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa721c0 00000100:00100000:3.0:1787756448.836892:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 7 00000100:00100000:3.0:1787756448.836902:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcdd3d25-193d-42cb-911a-069eb2969705+19:2364:x1874598264066048:12345-192.168.203.21@tcp:4:dd.0 00000100:00100000:3.0:1787756448.852312:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcdd3d25-193d-42cb-911a-069eb2969705+21:2364:x1874598264066048:12345-192.168.203.21@tcp:4:dd.0 Request processed in 15401us (16864us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787756448.852459:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 7 00002000:00100000:3.0:1787756448.852473:0:6698:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (6291456->6819839) req@ffff98afbfa721c0 x1874598264066048/t4294967307(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/448 e 0 to 0 dl 1787756459 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787756448.852484:0:6698:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa721c0 with x1874598264066048 ext(6291456->6819839) 00002000:00010000:3.0:1787756448.852490:0:6698:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa721c0 00000001:00080000:2.0:1787756448.907235:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1787756448.907258:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1787756448.907285:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787756448.907306:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000001:00080000:2.0:1787756448.907327:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000100:00100000:3.0:1787756448.908391:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787756448.908417:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287167104:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787756448.908492:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787756448.908690:0:8483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598287167104 00000100:00100000:0.0:1787756448.908697:0:8483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598287167104 00000100:00100000:0.0:1787756448.908755:0:8483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787756448.908765:0:8483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874598287167104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787756448.908793:0:8483:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787756448.908825:0:8483:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8eff9c, atime: 0x6a8eff9c, ctime: 0x6a8eff9c, blocks: 0x1 00010000:00010000:0.0:1787756448.908857:0:8483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082ef91eb/0x178386880caab3c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756448.908873:0:8483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1787756448.908877:0:8483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787756448.908883:0:8483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082ef91eb/0x178386880caab3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756448.908899:0:8483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082ef91eb/0x178386880caab3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756448.908909:0:8483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082ef91eb/0x178386880caab3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756448.908936:0:8483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082ef91eb/0x178386880caab3c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756448.908953:0:8483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787756448.909907:0:8483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1874598287167104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1141us (1411us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787756448.909917:0:8483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1787756448.909938:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787756448.909944:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082ef91eb/0x178386880caab3c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756448.909952:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff98af81543e00 already unused, calling callback (ffffffffc162d530) 00010000:00010000:0.0:1787756448.909957:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082ef91eb/0x178386880caab3c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756448.909967:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082ef91eb/0x178386880caab3c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756448.909986:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082ef91eb/0x178386880caab3c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756448.909993:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082ef91eb/0x178386880caab3c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787756448.910022:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756448.910030:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787756448.910032:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787756448.919252:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff98afbfca1e00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1787756448.919269:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff98afbfca1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1874598287167104:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787756448.920050:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787756448.949067:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:2.0:1787756448.949538:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264066176 00000100:00100000:2.0:1787756448.949548:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264066176 00002000:00100000:2.0:1787756448.949601:0:6696:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (7340032->7868415) req@ffff98afbfa63c00 x1874598264066176/t0(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/0 e 0 to 0 dl 1787756459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787756448.949612:0:6696:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa63c00 with x1874598264066176 ext(7340032->7868415) 00002000:00010000:2.0:1787756448.949617:0:6696:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa63c00 00000100:00100000:2.0:1787756448.949661:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 8 00000100:00100000:2.0:1787756448.949670:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcdd3d25-193d-42cb-911a-069eb2969705+21:2364:x1874598264066176:12345-192.168.203.21@tcp:4:dd.0 00000100:00100000:0.0:1787756448.954693:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa63c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bcdd3d25-193d-42cb-911a-069eb2969705+23:2364:x1874598264066176:12345-192.168.203.21@tcp:4:dd.0 Request processed in 5011us (5621us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787756448.954708:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 8 00002000:00100000:0.0:1787756448.954721:0:6696:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (7340032->7868415) req@ffff98afbfa63c00 x1874598264066176/t4294967309(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:264/0 lens 504/448 e 0 to 0 dl 1787756459 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787756448.954730:0:6696:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa63c00 with x1874598264066176 ext(7340032->7868415) 00002000:00010000:0.0:1787756448.954736:0:6696:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa63c00 00000100:00100000:3.0:1787756449.068936:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.21@tcp (source: 12345-192.168.203.21@tcp) 00000100:00100000:0.0:1787756449.069050:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874598264066304 00000100:00100000:0.0:1787756449.069060:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874598264066304 00002000:00100000:0.0:1787756449.069124:0:6698:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (8388608->8916991) req@ffff98afbfa63480 x1874598264066304/t0(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:265/0 lens 504/0 e 0 to 0 dl 1787756460 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787756449.069135:0:6698:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa63480 with x1874598264066304 ext(8388608->8916991) 00002000:00010000:0.0:1787756449.069141:0:6698:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa63480 00000100:00100000:0.0:1787756449.069179:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.21@tcp, seq: 9 00000100:00100000:0.0:1787756449.069190:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff98afbfa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcdd3d25-193d-42cb-911a-069eb2969705+23:2364:x1874598264066304:12345-192.168.203.21@tcp:4:dd.0 00000100:00080000:2.0:1787756449.069303:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787756449.070939:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff98afbfa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bcdd3d25-193d-42cb-911a-069eb2969705+25:2364:x1874598264066304:12345-192.168.203.21@tcp:4:dd.0 Request processed in 1742us (2005us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787756449.070952:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.21@tcp, seq: 9 00002000:00100000:0.0:1787756449.070963:0:6698:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (8388608->8916991) req@ffff98afbfa63480 x1874598264066304/t4294967310(0) o4->bcdd3d25-193d-42cb-911a-069eb2969705@192.168.203.21@tcp:265/0 lens 504/448 e 0 to 0 dl 1787756460 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787756449.070973:0:6698:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff98afbfa63480 with x1874598264066304 ext(8388608->8916991) 00002000:00010000:0.0:1787756449.070979:0:6698:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff98afbfa63480 Debug log: 9232 lines, 9232 kept, 0 dropped, 0 bad.