00000001:02000400:3.0F:1784755865.241089:0:2954:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg421-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1784755884.522976:0:3177:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1784755886.042781:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 627 MB/s 00000001:01000000:3.0:1784755886.292298:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 567 MB/s 00000001:01000000:3.0:1784755886.542568:0:3235:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3575 MB/s 00000020:02000000:0.0F:1784755887.301269:0:3269:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_183_g9c9e10a 00000400:02000000:3.0:1784755888.104340:0:3284:0:(api-ni.c:2766:lnet_startup_lndni()) Added LNI 192.168.204.121@tcp [8/256/0/180] 00008000:02000000:2.0F:1784755891.638723:0:3434:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1784755940.922694:0:5237:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg421-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784755948.792472:0:5763:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784755948.792477:0:5763:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1784755948.792648:0:5763:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000001cd7412c 00000080:02000400:2.0:1784755948.792659:0:5763:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1784755948.796975:0:5763:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1784755948.796988:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1784755948.797027:0:5763:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000244112b1) 00000020:00000080:2.0:1784755948.797048:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784755948.812314:0:5763:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1784755948.816321:0:5763:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1784755948.839078:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784755948.839111:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784755948.839128:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784755948.839172:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784755948.839213:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784755948.839622:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784755948.839630:0:5763:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784755948.839642:0:5763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbe94f39231c84bfc 00000020:01000004:3.0:1784755948.839649:0:5763:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1784755948.839654:0:5763:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784755948.839659:0:5763:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001cd7412c from MGS 00000020:01000004:3.0:1784755948.839664:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784755948.839682:0:5763:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000021c50e1b) 00000020:00000080:3.0:1784755948.839694:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784755948.839773:0:5763:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001cd7412c from MGS, refs=2 00080000:01000000:3.0:1784755948.839778:0:5763:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784755948.839784:0:5763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbe94f39231c84c0a 00000100:00100000:3.0:1784755948.839982:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784755948.840107:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784755948.840113:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784755948.840599:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784755948.840605:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1784755948.841244:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784755948.841368:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1784755948.841372:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1784755948.842213:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1784755948.842226:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1784755948.842512:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1784755948.842525:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1784755948.843262:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755948.843266:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755948.843268:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755948.843636:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755948.843638:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755948.843639:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755948.844260:0:5763:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1784755948.846104:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1784755949.093936:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4003 MB/s 00000001:01000000:2.0:1784755949.343877:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5131 MB/s 00000001:01000000:2.0:1784755949.594222:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1171 MB/s 00000001:01000000:2.0:1784755949.844105:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1343 MB/s 00010000:00010000:0.0:1784755949.848992:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1784755949.850625:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1784755949.863446:0:5763:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1784755949.863463:0:5763:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784755949.863466:0:5763:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1784755949.864225:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1784755949.864273:0:5763:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1784755949.864383:0:5763:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1784755949.864789:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1784755949.865020:0:5763:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1784755949.865349:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755949.865491:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1784755949.865497:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784755949.866240:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784755949.866248:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784755949.866547:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784755949.866554:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1784755949.867591:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1784755949.867611:0:5763:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.121@tcp' 00000020:01000004:0.0:1784755949.867613:0:5763:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1784755949.867757:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.121@tcp (typ=mgc) 00000020:00000080:0.0:1784755949.867775:0:5763:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.121@tcp (00000000f2422a42) 00000020:00000080:0.0:1784755949.867791:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1784755949.867937:0:5763:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001593d67c@MGC192.168.204.121@tcp: add connection 192.168.204.121@tcp at head 00010000:00010000:0.0:1784755949.868093:0:5763:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.121@tcp-0 is initialized 00000040:01000000:0.0:1784755949.868099:0:5763:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.121@tcp ctxt 1 is initialized 10000000:01000000:3.0:1784755949.869633:0:5779:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1784755949.869667:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.121@tcp (uuid f9117e42-6e26-4b4a-b619-3540b762413c) 00000020:00000080:3.0:1784755949.869687:0:5763:0:(genops.c:1406:class_connect()) connect: client f9117e42-6e26-4b4a-b619-3540b762413c, cookie 0xbe94f39231c84c18 00000100:00080000:3.0:1784755949.869712:0:5763:0:(import.c:510:import_select_connection()) MGC192.168.204.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784755949.869718:0:5763:0:(import.c:624:import_select_connection()) MGC192.168.204.121@tcp: import 000000001593d67c using connection 192.168.204.121@tcp/0@lo 00000100:00100000:3.0:1784755949.869759:0:5763:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001a7656af x1871452190015616/t0(0) o250->MGC192.168.204.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784755949.869974:0:5763:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f9117e42-6e26-4b4a-b619-3540b762413c->MGS 00000020:01000004:3.0:1784755949.869990:0:5763:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784755949.869994:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1784755949.870006:0:5763:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000009763391a) 00000020:00000080:3.0:1784755949.870018:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1784755949.870263:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001a7656af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9117e42-6e26-4b4a-b619-3540b762413c:3299:1871452190015616:0@lo:250: 00000100:00100000:1.0:1784755949.870357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755949.870402:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190015616 00000100:00100000:2.0:1784755949.870410:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190015616 00000100:00100000:2.0:1784755949.870442:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784755949.870449:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034b18630 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1871452190015616:12345-0@lo:250: 00010000:00080000:2.0:1784755949.870468:0:5774:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f9117e42-6e26-4b4a-b619-3540b762413c@0@lo t0 exp 0000000000000000 cur 130 last 0 00000100:00080000:1.0:1784755949.870486:0:5778:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1784755949.870490:0:5774:0:(genops.c:1406:class_connect()) connect: client f9117e42-6e26-4b4a-b619-3540b762413c, cookie 0xbe94f39231c84c26 00000100:00080000:2.0:1784755949.870640:0:5774:0:(import.c:65:import_set_state_nolock()) 00000000eff25fa7 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784755949.870744:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034b18630 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+5:3299:x1871452190015616:12345-0@lo:250: Request processed in 293us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755949.870755:0:3299:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.121@tcp: committing for last_committed 0 gen 1 00000100:00100000:2.0:1784755949.870756:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1784755949.870765:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.121@tcp: connect to target with instance 0 00000100:00080000:1.0:1784755949.870773:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784755949.870777:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784755949.870780:0:3299:0:(import.c:65:import_set_state_nolock()) 000000001593d67c MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784755949.870783:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784755949.870792:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784755949.870798:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001a7656af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f9117e42-6e26-4b4a-b619-3540b762413c:3299:1871452190015616:0@lo:250: 00000100:00100000:3.0:1784755949.882717:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784755949.883040:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1784755949.883047:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1784755949.883819:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1784755949.883828:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784755949.884460:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1784755949.884467:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1784755949.885256:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784755949.885380:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1784755949.885384:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1784755949.885854:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1784755949.885861:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1784755949.931795:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784755949.932007:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1784755949.932013:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1784755949.934769:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1784755949.934785:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1784755949.941182:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784755949.941356:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784755949.941363:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784755949.942574:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784755949.942584:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1784755949.945381:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784755949.945541:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784755949.945547:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1784755949.946343:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784755949.946350:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1784755949.947104:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784755949.947375:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784755949.947381:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1784755949.947939:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784755949.947951:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1784755949.969560:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784755949.969757:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784755949.969771:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1784755949.971426:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784755949.971438:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784755949.974052:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784755949.974064:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784755949.977012:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784755949.977039:0:5763:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1784755949.977045:0:5763:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784755949.977161:0:5763:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784755949.977211:0:5763:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.121@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1784755949.977215:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784755949.977217:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784755949.977218:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755949.977219:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755949.977220:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755949.977222:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755949.977223:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784755949.977224:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784755949.977226:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755949.977227:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755949.977228:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755949.977230:0:5763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784755949.977232:0:5763:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1784755949.977234:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784755949.977235:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784755949.977236:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755949.977238:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755949.977239:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755949.977240:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755949.977241:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784755949.977242:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784755949.977243:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755949.977244:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755949.977248:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755949.977249:0:5763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784755949.977277:0:5763:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784755949.977293:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e7e1fdfc pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190015744:0@lo:253: 00000100:00100000:2.0:1784755949.977360:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755949.978141:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bd68c49c going to sleep for 11 seconds 00000100:00100000:3.0:1784755949.978355:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190015744 00000100:00100000:3.0:1784755949.978363:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190015744 00000100:00100000:3.0:1784755949.978404:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784755949.978411:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076a6cf58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+5:5763:x1871452190015744:12345-0@lo:253: 20000000:01000000:3.0:1784755949.978459:0:5777:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784755949.978462:0:5777:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1784755949.980117:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784755949.980165:0:5777:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1784755949.980865:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784755949.983811:0:5798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1784755949.984221:0:5777:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784755949.984226:0:5777:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1784755949.984232:0:5777:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1784755949.984236:0:5777:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1784755949.984251:0:5777:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1784755949.984470:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784755949.985769:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1784755949.985787:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784755949.985866:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1784755949.985939:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1784755949.985989:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1784755949.986106:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1784755949.986114:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1784755949.986161:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1784755949.986169:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1784755949.986199:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1784755949.986207:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1784755949.986239:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1784755949.986287:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1784755949.986316:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1784755949.986321:0:5777:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1784755949.986332:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784755949.986509:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1784755949.986518:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784755949.986549:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1784755949.986584:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1784755949.986630:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1784755949.986641:0:5777:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1784755949.986724:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1784755949.986733:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784755949.986778:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1784755949.986812:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1784755949.986874:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1784755949.986886:0:5777:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1784755949.986979:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1784755949.986988:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1784755949.987024:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1784755949.987074:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1784755949.987225:0:5777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1784755949.987274:0:5777:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1784755949.987281:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1784755949.990437:0:5799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1784755949.990794:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1784755949.990820:0:5777:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.121@tcp for mdt 20000000:01000000:1.0:1784755949.990822:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.121@tcp (null) (null) (null) 00000040:00080000:1.0:1784755949.990884:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1784755949.990891:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784755949.990945:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1784755949.990952:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.121@tcp (null) (null) 00000040:00080000:1.0:1784755949.990993:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1784755949.991003:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1784755949.991048:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1784755949.991206:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1784755949.991260:0:5777:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784755949.991264:0:5777:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784755949.991268:0:5777:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1784755949.991274:0:5777:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1784755949.991601:0:5800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1784755949.992435:0:5777:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1784755950.003474:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1784755950.003664:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1784755950.003758:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1784755950.003779:0:5777:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784755950.003781:0:5777:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784755950.003785:0:5777:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784755950.003799:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784755950.003801:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784755950.003990:0:5777:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784755950.003993:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784755950.004998:0:5801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1784755950.005239:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1784755950.005274:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1784755950.005341:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1784755950.005354:0:5777:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784755950.005365:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784755950.006163:0:5802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1784755950.006442:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1784755950.006485:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1784755950.006520:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1784755950.006532:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784755950.006535:0:5777:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1784755950.006541:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784755950.006561:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c2d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.006578:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c2d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.006588:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.006594:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c2d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.006600:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c2d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.006607:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.006614:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f8a6f1b already unused, calling callback (00000000168e3e73) 00010000:00010000:1.0:1784755950.006618:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c2d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.006625:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c2d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.006636:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c2d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.006652:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c2d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.006658:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c2d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784755950.006674:0:5777:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784755950.193065:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076a6cf58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+5:5763:x1871452190015744:12345-0@lo:253: Request processed in 214645us (215697us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755950.193087:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784755950.194663:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e7e1fdfc pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190015744:0@lo:253: 10000000:01000000:2.0:1784755950.194682:0:5763:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784755950.194685:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784755950.194698:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784755950.194699:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755950.194700:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1784755950.194702:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755950.194703:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755950.194704:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784755950.194706:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784755950.194707:0:5763:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784755950.194708:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755950.194710:0:5763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784755950.195730:0:5763:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001cd7412c from lustre-MDT0000 10000000:01000000:3.0:1784755950.195758:0:5763:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784755950.195761:0:5763:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784755950.195765:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff96f185184d40 10000000:01000000:3.0:1784755950.195769:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784755950.195776:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff96f185184d40 from 1 10000000:01000000:3.0:1784755950.195779:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784755950.195813:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.195823:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.195862:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755950.195881:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190015872:0@lo:101: 00000100:00100000:3.0:1784755950.195951:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755950.196926:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b4b2d620 going to sleep for 11 seconds 00000100:00100000:1.0:1784755950.196939:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190015872 00000100:00100000:1.0:1784755950.196947:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190015872 00000100:00100000:1.0:1784755950.197106:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784755950.197115:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086e131fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+5:5763:x1871452190015872:12345-0@lo:101: 00010000:00010000:1.0:1784755950.197130:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755950.197143:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84c34 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.197165:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84c34 expref: 6 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.197173:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84c34 expref: 6 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.197182:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f8a6f1b, rc 0) 00000100:00100000:1.0:1784755950.197232:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086e131fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+6:5763:x1871452190015872:12345-0@lo:101: Request processed in 120us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755950.197238:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784755950.197531:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190015872:0@lo:101: 00010000:00010000:3.0:1784755950.197544:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.197551:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755950.197594:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016000:0@lo:501: 00000100:00100000:3.0:1784755950.197625:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755950.197646:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b4b2d620 going to sleep for 11 seconds 00000100:00100000:1.0:1784755950.197767:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190016000 00000100:00100000:1.0:1784755950.197773:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190016000 00000100:00100000:1.0:1784755950.197805:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784755950.197811:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032f15edf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+6:5763:x1871452190016000:12345-0@lo:501: 00000100:00100000:1.0:1784755950.198245:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032f15edf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+6:5763:x1871452190016000:12345-0@lo:501: Request processed in 433us (619us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784755950.198254:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784755950.198285:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016000:0@lo:501: 10000000:01000000:3.0:1784755950.198312:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784755950.198332:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.198342:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755950.198351:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96f18794d800 10000000:01000000:3.0:1784755950.198355:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784755950.198359:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff96f18794d800 10000000:01000000:3.0:1784755950.198362:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784755950.198365:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff96f18794d800 from 1 10000000:01000000:3.0:1784755950.198368:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784755950.198387:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: 00000000a904944b/0xbe94f39231c84c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.198393:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: 00000000a904944b/0xbe94f39231c84c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.198400:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: 00000000a904944b/0xbe94f39231c84c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755950.198413:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016128:0@lo:101: 00000100:00100000:3.0:1784755950.198437:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755950.198466:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b4b2d620 going to sleep for 11 seconds 00000100:00100000:1.0:1784755950.198622:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190016128 00000100:00100000:1.0:1784755950.198628:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190016128 00000100:00100000:1.0:1784755950.198658:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784755950.198664:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000759a1bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+6:5763:x1871452190016128:12345-0@lo:101: 00010000:00010000:1.0:1784755950.198672:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755950.198683:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002610b70e/0xbe94f39231c84c49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84c42 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.198710:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002610b70e/0xbe94f39231c84c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84c42 expref: 7 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.198721:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002610b70e/0xbe94f39231c84c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84c42 expref: 7 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.198730:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002610b70e, rc 0) 00000100:00100000:1.0:1784755950.198768:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000759a1bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+7:5763:x1871452190016128:12345-0@lo:101: Request processed in 104us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755950.198774:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784755950.198886:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016128:0@lo:101: 00010000:00010000:3.0:1784755950.198896:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: 00000000a904944b/0xbe94f39231c84c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84c49 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.198910:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: 00000000a904944b/0xbe94f39231c84c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84c49 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755950.198922:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784755950.198939:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: 00000000a904944b/0xbe94f39231c84c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84c49 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.198945:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: 00000000a904944b/0xbe94f39231c84c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84c49 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755950.198952:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784755950.198955:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784755950.198958:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff96f18794d800 10000000:01000000:3.0:1784755950.198961:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784755950.198963:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784755950.199021:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784755950.199035:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.199042:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.199047:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755950.199059:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016256:0@lo:101: 00000100:00100000:3.0:1784755950.199083:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755950.199172:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b4b2d620 going to sleep for 11 seconds 00000100:00100000:0.0:1784755950.199286:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190016256 00000100:00100000:0.0:1784755950.199291:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190016256 00000100:00100000:0.0:1784755950.199320:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784755950.199325:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8b71430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+7:5763:x1871452190016256:12345-0@lo:101: 00010000:00010000:0.0:1784755950.199332:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755950.199340:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aff315cb/0xbe94f39231c84c57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84c50 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.199354:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aff315cb/0xbe94f39231c84c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84c50 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.199362:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aff315cb/0xbe94f39231c84c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84c50 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.199368:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aff315cb, rc 0) 00000100:00100000:0.0:1784755950.199491:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8b71430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+8:5763:x1871452190016256:12345-0@lo:101: Request processed in 166us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755950.199497:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784755950.199592:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016256:0@lo:101: 00010000:00010000:3.0:1784755950.199602:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.199610:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755950.199648:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016384:0@lo:501: 00000100:00100000:3.0:1784755950.199670:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755950.199698:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b4b2d620 going to sleep for 11 seconds 00000100:00100000:1.0:1784755950.199723:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190016384 00000100:00100000:1.0:1784755950.199728:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190016384 00000100:00100000:1.0:1784755950.199754:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784755950.199761:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022bfdf2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+8:5763:x1871452190016384:12345-0@lo:501: 00000100:00100000:1.0:1784755950.201254:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022bfdf2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+9:5763:x1871452190016384:12345-0@lo:501: Request processed in 1489us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755950.201266:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784755950.201418:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016384:0@lo:501: 00000100:00100000:3.0:1784755950.201457:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016512:0@lo:503: 00000100:00100000:3.0:1784755950.201501:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755950.201534:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b4b2d620 going to sleep for 11 seconds 00000100:00100000:0.0:1784755950.201584:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190016512 00000100:00100000:0.0:1784755950.201591:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190016512 00000100:00100000:0.0:1784755950.201632:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784755950.201640:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a79593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+9:5763:x1871452190016512:12345-0@lo:503: 00000100:00100000:0.0:1784755950.201826:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a79593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+9:5763:x1871452190016512:12345-0@lo:503: Request processed in 188us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755950.201864:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784755950.202065:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016512:0@lo:503: 00000100:00100000:1.0:1784755950.202498:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000211a497b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:5805:1871452190016640:0@lo:502: 00000100:00100000:1.0:1784755950.202532:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755950.202600:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set 000000000b58cf99 going to sleep for 11 seconds 00000100:00100000:3.0:1784755950.202636:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190016640 00000100:00100000:3.0:1784755950.202641:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190016640 00000100:00100000:2.0:1784755950.202675:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784755950.202695:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065ebd0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+9:5805:x1871452190016640:12345-0@lo:502: 00000100:00100000:2.0:1784755950.202935:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065ebd0a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+9:5805:x1871452190016640:12345-0@lo:502: Request processed in 252us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755950.202943:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784755950.203016:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000211a497b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:5805:1871452190016640:0@lo:502: 00000020:01000000:1.0:1784755950.203037:0:5805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784755950.203047:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755950.203049:0:5805:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784755950.203054:0:5805:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784755950.203057:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784755950.203076:0:5805:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000544183cf) 00000020:00000080:1.0:1784755950.203095:0:5805:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1784755950.203102:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784755950.203174:0:5805:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784755950.203181:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbe94f39231c84c65 00000020:00000080:1.0:1784755950.203447:0:5805:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784755950.203451:0:5805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755950.203454:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755950.203456:0:5805:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784755950.203458:0:5805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784755950.203461:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755950.203463:0:5805:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784755950.203466:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784755950.203470:0:5805:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009c87958f) 00000020:00000080:1.0:1784755950.203479:0:5805:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1784755950.203483:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784755950.203484:0:5805:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784755950.203487:0:5805:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784755950.203497:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784755950.203536:0:5805:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001cd7412c from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784755950.203545:0:5805:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000009a0eacd) 00000020:00000080:1.0:1784755950.203552:0:5805:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1784755950.203594:0:5805:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784755950.203598:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbe94f39231c84c7a 00000020:00000080:1.0:1784755950.203702:0:5805:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784755950.203708:0:5805:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784755950.203713:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbe94f39231c84c81 00080000:01000000:1.0:1784755950.203717:0:5805:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784755950.203720:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbe94f39231c84c88 00080000:10000000:1.0:1784755950.204124:0:5805:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1784755950.204467:0:5805:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1784755950.207540:0:5805:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1784755950.256170:0:5805:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1784755950.256469:0:5805:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1784755950.258740:0:5805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1784755950.259317:0:5805:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1784755950.283159:0:5805:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000008c5075c7) 00000020:00000080:0.0:1784755950.283179:0:5805:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1784755950.283253:0:5805:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784755950.283267:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbe94f39231c84c96 00000020:00000080:0.0:1784755950.284453:0:5805:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1784755950.286752:0:5805:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784755950.311864:0:5805:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784755950.342899:0:5805:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784755950.370559:0:5805:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784755950.398822:0:5805:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784755950.422708:0:5805:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1784755950.441461:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbe94f39231c84c9d 00000020:00000080:2.0:1784755950.441780:0:5805:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784755950.441789:0:5805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784755950.441793:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755950.441795:0:5805:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784755950.441797:0:5805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784755950.441802:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755950.441802:0:5805:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784755950.441805:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784755950.441925:0:5805:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784755950.441960:0:5805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784755950.441964:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755950.441966:0:5805:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784755950.441969:0:5805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784755950.441971:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755950.441972:0:5805:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784755950.441975:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784755950.441977:0:5805:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784755950.442020:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e7e1fdfc pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:5805:1871452190016768:0@lo:502: 00000100:00100000:2.0:1784755950.442096:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755950.442144:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190016768 00000100:00100000:0.0:1784755950.442152:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190016768 00000100:00100000:2.0:1784755950.442161:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set 000000007228db53 going to sleep for 11 seconds 00000100:00100000:0.0:1784755950.442234:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784755950.442244:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb33d562 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+9:5805:x1871452190016768:12345-0@lo:502: 00000100:00100000:0.0:1784755950.442597:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb33d562 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+9:5805:x1871452190016768:12345-0@lo:502: Request processed in 354us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755950.442607:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784755950.442624:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e7e1fdfc pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:5805:1871452190016768:0@lo:502: 00000020:01000000:2.0:1784755950.442658:0:5805:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784755950.442662:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755950.442664:0:5805:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784755950.442667:0:5805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1784755950.442744:0:5763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1784755950.442765:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784755950.442785:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.442797:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755950.442804:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff96f18794d800 from 1 10000000:01000000:3.0:1784755950.442807:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784755950.442830:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.442857:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.442865:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755950.442877:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016896:0@lo:101: 00000100:00100000:3.0:1784755950.442916:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755950.442939:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f52ae9a5 going to sleep for 11 seconds 00000100:00100000:2.0:1784755950.442970:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190016896 00000100:00100000:2.0:1784755950.442976:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190016896 00000100:00100000:2.0:1784755950.443010:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784755950.443016:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008eb09b95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+9:5763:x1871452190016896:12345-0@lo:101: 00010000:00010000:2.0:1784755950.443025:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755950.443043:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84ca4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.443062:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84ca4 expref: 10 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.443072:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84ca4 expref: 10 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.443080:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f9d8fcd1, rc 0) 00000100:00100000:2.0:1784755950.443123:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008eb09b95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+10:5763:x1871452190016896:12345-0@lo:101: Request processed in 107us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755950.443129:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784755950.443181:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009d5ace52 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190016896:0@lo:101: 00010000:00010000:1.0:1784755950.443196:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.443204:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755950.443774:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000211a497b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017024:0@lo:256: 00000100:00100000:1.0:1784755950.443809:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755950.443861:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000babd9eb5 going to sleep for 11 seconds 00000100:00100000:0.0:1784755950.443963:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190017024 00000100:00100000:0.0:1784755950.443968:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190017024 00000100:00100000:0.0:1784755950.444038:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784755950.444045:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1b961e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+10:5763:x1871452190017024:12345-0@lo:256: 20000000:01000000:0.0:1784755950.444059:0:5777:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784755950.444064:0:5777:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1784755950.444130:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1b961e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+10:5763:x1871452190017024:12345-0@lo:256: Request processed in 86us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755950.444137:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784755950.444198:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000211a497b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017024:0@lo:256: 10000000:01000000:1.0:1784755950.444746:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784755950.444779:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.444788:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755950.444795:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96f18794d800 from 1 10000000:01000000:1.0:1784755950.444798:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784755950.444830:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.444864:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.444871:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755950.444883:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000211a497b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017152:0@lo:101: 00000100:00100000:1.0:1784755950.444913:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755950.444940:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000babd9eb5 going to sleep for 11 seconds 00000100:00100000:2.0:1784755950.444954:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190017152 00000100:00100000:2.0:1784755950.444960:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190017152 00000100:00100000:2.0:1784755950.444996:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784755950.445004:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064e2e16a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+10:5763:x1871452190017152:12345-0@lo:101: 00010000:00010000:2.0:1784755950.445013:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755950.445023:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f923b454/0xbe94f39231c84cb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84cb2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.445041:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f923b454/0xbe94f39231c84cb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84cb2 expref: 11 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.445050:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f923b454/0xbe94f39231c84cb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84cb2 expref: 11 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.445058:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f923b454, rc 0) 00000100:00100000:2.0:1784755950.445098:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064e2e16a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+11:5763:x1871452190017152:12345-0@lo:101: Request processed in 96us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755950.445120:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784755950.445128:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000211a497b pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017152:0@lo:101: 00010000:00010000:3.0:1784755950.445141:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.445149:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755950.445192:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000033728f18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017280:0@lo:501: 00000100:00100000:3.0:1784755950.445215:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755950.445239:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 000000005ca19393 going to sleep for 11 seconds 00000100:00100000:0.0:1784755950.445292:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190017280 00000100:00100000:0.0:1784755950.445296:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190017280 00000100:00100000:0.0:1784755950.445320:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784755950.445333:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a78a7f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+11:5763:x1871452190017280:12345-0@lo:501: 00000100:00100000:0.0:1784755950.445879:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a78a7f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+11:5763:x1871452190017280:12345-0@lo:501: Request processed in 547us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755950.445887:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784755950.446080:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000033728f18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017280:0@lo:501: 00000100:00100000:3.0:1784755950.446110:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000033728f18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017408:0@lo:503: 00000100:00100000:3.0:1784755950.446141:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755950.446163:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 000000005ca19393 going to sleep for 11 seconds 00000100:00100000:2.0:1784755950.446203:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190017408 00000100:00100000:2.0:1784755950.446207:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190017408 00000100:00100000:2.0:1784755950.446227:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784755950.446231:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080517c57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+11:5763:x1871452190017408:12345-0@lo:503: 00000040:00080000:2.0:1784755950.446256:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784755950.446317:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080517c57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+11:5763:x1871452190017408:12345-0@lo:503: Request processed in 86us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755950.446322:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784755950.446399:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000033728f18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017408:0@lo:503: 00000040:00080000:0.0:1784755950.449751:0:5809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1784755950.450127:0:5763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1784755950.450162:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784755950.450216:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.450227:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755950.450266:0:5763:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784755950.450268:0:5763:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96f18794d800 10000000:01000000:3.0:1784755950.450272:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96f18794d800 10000000:01000000:3.0:1784755950.450275:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784755950.450280:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96f18794d800 from 1 10000000:01000000:3.0:1784755950.450283:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784755950.450315:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.450322:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755950.450331:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755950.450351:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000033728f18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017536:0@lo:101: 00000100:00100000:3.0:1784755950.450412:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755950.450456:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 000000006c31a890 going to sleep for 11 seconds 00000100:00100000:2.0:1784755950.450517:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190017536 00000100:00100000:2.0:1784755950.450525:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190017536 00000100:00100000:2.0:1784755950.450571:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784755950.450579:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fbda87f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+11:5763:x1871452190017536:12345-0@lo:101: 00010000:00010000:2.0:1784755950.450591:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755950.450602:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000028597df3/0xbe94f39231c84cc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84cc0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.450625:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000028597df3/0xbe94f39231c84cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84cc0 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.450635:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000028597df3/0xbe94f39231c84cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84cc0 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.450643:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000028597df3, rc 0) 00000100:00100000:2.0:1784755950.450701:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fbda87f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:5763:x1871452190017536:12345-0@lo:101: Request processed in 122us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755950.450708:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784755950.451198:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000033728f18 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017536:0@lo:101: 00010000:00010000:0.0:1784755950.451213:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.451221:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755950.451282:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007a9fb4cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017664:0@lo:501: 00000100:00100000:0.0:1784755950.451307:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755950.451325:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000abcfcb33 going to sleep for 11 seconds 00000100:00100000:1.0:1784755950.451364:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190017664 00000100:00100000:1.0:1784755950.451369:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190017664 00000100:00100000:1.0:1784755950.451423:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784755950.451429:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea29f841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:5763:x1871452190017664:12345-0@lo:501: 00000100:00100000:1.0:1784755950.451660:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea29f841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:5763:x1871452190017664:12345-0@lo:501: Request processed in 231us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755950.451666:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784755950.451731:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007a9fb4cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017664:0@lo:501: 00000100:00100000:0.0:1784755950.451755:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007a9fb4cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017792:0@lo:503: 00000100:00100000:0.0:1784755950.451789:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755950.452821:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000abcfcb33 going to sleep for 11 seconds 00000100:00100000:2.0:1784755950.453130:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190017792 00000100:00100000:2.0:1784755950.453142:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190017792 00000100:00100000:2.0:1784755950.453166:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784755950.453170:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071bcda3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:5763:x1871452190017792:12345-0@lo:503: 00000100:00100000:2.0:1784755950.453435:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071bcda3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:5763:x1871452190017792:12345-0@lo:503: Request processed in 265us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755950.453440:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784755950.453515:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007a9fb4cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190017792:0@lo:503: 00000100:00100000:0.0:1784755950.453805:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007a9fb4cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:5810:1871452190017920:0@lo:502: 00000100:00100000:0.0:1784755950.453988:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755950.454090:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set 00000000267b68ee going to sleep for 11 seconds 00000100:00100000:3.0:1784755950.454170:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190017920 00000100:00100000:3.0:1784755950.454175:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190017920 00000100:00100000:2.0:1784755950.454210:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784755950.454217:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f02640cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:5810:x1871452190017920:12345-0@lo:502: 00000100:00100000:2.0:1784755950.454399:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f02640cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:5810:x1871452190017920:12345-0@lo:502: Request processed in 183us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755950.454406:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784755950.454443:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007a9fb4cf pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:5810:1871452190017920:0@lo:502: 00000020:01000004:1.0:1784755950.454496:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784755950.454514:0:5810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002e06afa3) 00000020:00000080:1.0:1784755950.454532:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1784755950.454747:0:5810:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001cd7412c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784755950.454752:0:5810:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001cd7412c from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784755950.454754:0:5810:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001cd7412c 4 00010000:00080000:1.0:1784755950.454779:0:5810:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004d2f5ccd@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.121@tcp at head 00010000:00010000:1.0:1784755950.456747:0:5810:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1784755950.458405:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784755950.458454:0:5810:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784755950.458468:0:5810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbe94f39231c84cd5 00000100:00080000:1.0:1784755950.458477:0:5810:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784755950.458482:0:5810:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004d2f5ccd using connection 192.168.204.121@tcp/0@lo 00000100:00100000:1.0:1784755950.458514:0:5810:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007394648f x1871452190018048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784755950.458550:0:5810:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784755950.459780:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007394648f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1871452190018048:0@lo:38: 00000100:00100000:2.0:1784755950.459870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755950.459938:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190018048 00000100:00100000:2.0:1784755950.459945:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190018048 00000100:00100000:2.0:1784755950.459975:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784755950.459980:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7e1fdfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1871452190018048:12345-0@lo:38: 00000100:00100000:2.0:1784755950.460036:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7e1fdfc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1871452190018048:12345-0@lo:38: Request processed in 55us (167us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784755950.460045:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784755950.460220:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784755950.460227:0:3299:0:(import.c:65:import_set_state_nolock()) 000000004d2f5ccd lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784755950.460232:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784755950.460236:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007394648f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1871452190018048:0@lo:38: 00000100:00100000:2.0:1784755950.460270:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099b06457 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:5810:1871452190018176:0@lo:502: 00000100:00100000:2.0:1784755950.460311:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755950.460333:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set 00000000712fdc4c going to sleep for 11 seconds 00000100:00100000:1.0:1784755950.460424:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190018176 00000100:00100000:1.0:1784755950.460429:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190018176 00000100:00100000:1.0:1784755950.460464:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784755950.460469:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f32f577 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:5810:x1871452190018176:12345-0@lo:502: 00000100:00100000:2.0:1784755950.460974:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099b06457 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:5810:1871452190018176:0@lo:502: 00000040:00080000:2.0:1784755950.460998:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1784755950.461140:0:5763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1784755950.461166:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784755950.461213:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.461230:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784755950.461273:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784755950.461275:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784755950.461277:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755950.461278:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784755950.461279:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755950.461281:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755950.461282:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784755950.461283:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784755950.461285:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784755950.461286:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784755950.461287:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755950.461289:0:5763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784755950.461292:0:5763:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1784755950.461295:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784755950.461296:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784755950.461297:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755950.461299:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784755950.461300:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755950.461301:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755950.461302:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784755950.461303:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784755950.461304:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784755950.461305:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784755950.461306:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755950.461306:0:5763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784755950.461319:0:5763:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784755950.461329:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d62654c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190018304:0@lo:253: 00000100:00100000:1.0:1784755950.465209:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f32f577 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:5810:x1871452190018176:12345-0@lo:502: Request processed in 4732us (4890us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755950.465224:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784755950.466871:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755950.466918:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 0000000054fe3ca5 going to sleep for 11 seconds 00000100:00100000:0.0:1784755950.467190:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190018304 00000100:00100000:0.0:1784755950.467207:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190018304 00000100:00100000:0.0:1784755950.467275:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784755950.467285:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039dac08d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:5763:x1871452190018304:12345-0@lo:253: 20000000:01000000:0.0:1784755950.467337:0:5774:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784755950.467352:0:5774:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784755950.506745:0:5774:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784755950.506772:0:5774:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784755950.506796:0:5797:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784755950.506805:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784755950.506825:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.506889:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84ca4 expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.506897:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.506938:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84ca4 expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755950.506954:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84ca4 expref: 12 pid: 5774 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755950.506983:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099b06457 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5797:1871452190018432:0@lo:104: 00000100:00100000:2.0:1784755950.507044:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755950.507107:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set 00000000adfee71f going to sleep for 11 seconds 00000100:00100000:1.0:1784755950.507556:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190018432 00000100:00100000:1.0:1784755950.507564:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190018432 00000100:00100000:1.0:1784755950.507612:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784755950.507623:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a16baf4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9117e42-6e26-4b4a-b619-3540b762413c+3:5797:x1871452190018432:12345-0@lo:104: 00010000:00010000:1.0:1784755950.507635:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.507706:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784755950.507710:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a16baf4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9117e42-6e26-4b4a-b619-3540b762413c+3:5797:x1871452190018432:12345-0@lo:104: Request processed in 90us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755950.507715:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1784755950.507741:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784755950.507745:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.507751:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e23bbbe2 already unused, calling callback (00000000dd063f9b) 10000000:00010000:0.0:1784755950.507753:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.507759:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755950.507763:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755950.507766:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784755950.507800:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.507806:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755950.507824:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.507845:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84ca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cab expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.507864:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755950.507866:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755950.507868:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755950.507871:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099b06457 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5797:1871452190018432:0@lo:104: 00010000:00010000:2.0:1784755950.507902:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755950.507956:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073ac9f96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190018560:0@lo:103: 00000100:00100000:0.0:1784755950.507996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755950.508332:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190018560 00000100:00100000:1.0:1784755950.508338:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190018560 00010000:00010000:1.0:1784755950.508355:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84ca4 expref: 13 pid: 5774 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755950.508382:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784755950.508389:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000700efe3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+13:3301:x1871452190018560:12345-0@lo:103: 00010000:00010000:1.0:1784755950.508399:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784755950.508404:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84ca4 expref: 13 pid: 5774 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.508414:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84ca4 expref: 13 pid: 5774 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.508426:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84ca4 expref: 13 pid: 5774 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.508440:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.508453:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784755950.508465:0:5767:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001659764s 00010000:00010000:1.0:1784755950.508468:0:5767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.508473:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.508479:0:5767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.508485:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.508490:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c394186a already unused, calling callback (00000000168e3e73) 00010000:00010000:1.0:1784755950.508493:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.508512:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.508528:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.508543:0:5797:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755950.508547:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784755950.508552:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755950.508556:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c394186a/0xbe94f39231c84cdc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755950.508590:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000700efe3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+12:3301:x1871452190018560:12345-0@lo:103: Request processed in 200us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755950.508596:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073ac9f96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190018560:0@lo:103: 00000100:00100000:1.0:1784755950.508600:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784755950.512856:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039dac08d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+11:5763:x1871452190018304:12345-0@lo:253: Request processed in 45543us (45961us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755950.512872:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784755950.512965:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d62654c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:5763:1871452190018304:0@lo:253: 10000000:01000000:2.0:1784755950.512981:0:5763:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784755950.512983:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784755950.512985:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784755950.512986:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784755950.512987:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784755950.512998:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784755950.512999:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784755950.513000:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784755950.513001:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784755950.513002:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784755950.513003:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784755950.513004:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784755950.513005:0:5763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784755950.513016:0:5763:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784755950.519621:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755950.521447:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755950.521808:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755950.522033:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755950.522172:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755950.522284:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755950.523422:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755950.523620:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755950.523825:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755950.524029:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1784755950.524242:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1784755950.524419:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1784755950.554932:0:5763:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1784755950.581557:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1784755950.581727:0:5815:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1784755950.581732:0:5815:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1784755950.582096:0:5816:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1784755950.586369:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784755950.586479:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1784755950.586945:0:5763:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784755950.586951:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784755950.588472:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784755950.589452:0:5763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784755950.590002:0:5763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784755950.590033:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784755950.590271:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1784755950.590613:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1784755950.594645:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1784755950.594875:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1784755950.595011:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1784755950.595167:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1784755950.595319:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1784755950.595464:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1784755950.595598:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1784755950.595760:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1784755950.595947:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1784755950.596091:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1784755950.596222:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1784755950.596421:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1784755950.596665:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1784755950.596829:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1784755950.597065:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1784755950.597210:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1784755950.597584:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1784755950.598050:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1784755950.598304:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1784755950.598519:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1784755950.598745:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1784755950.598911:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1784755950.599110:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1784755950.599307:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1784755950.599463:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1784755950.599592:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1784755950.599746:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1784755950.600079:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1784755950.600523:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1784755950.600696:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1784755950.600933:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1784755950.601066:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1784755950.601267:0:5763:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1784755950.626227:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1784755950.672619:0:5763:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784755950.672660:0:5763:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc3181d5f988 00100000:10000000:1.0:1784755950.672669:0:5763:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784755950.673415:0:5763:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784755950.673429:0:5763:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784755950.673445:0:5763:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784755950.673470:0:5763:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1784755950.722948:0:5816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784755950.723030:0:5816:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784755950.723034:0:5816:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1784755950.874473:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755951.896919:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755952.926682:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784755953.625045:0:6058:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784755953.944991:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755954.983289:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784755955.481211:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784755955.481222:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784755955.481225:0:8:0:(import.c:65:import_set_state_nolock()) 000000004d2f5ccd lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784755955.481258:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004d2f5ccd using connection 192.168.204.121@tcp/0@lo 00000100:00100000:0.0:1784755955.481291:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f43980dd x1871452190018816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784755955.481295:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784755955.481309:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073ac9f96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190018688:0@lo:400: 00000100:00100000:3.0:1784755955.481379:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755955.481450:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190018688 00000100:00100000:3.0:1784755955.481456:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190018688 00000100:00100000:3.0:1784755955.481489:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784755955.481494:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f211847d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+11:3303:x1871452190018688:12345-0@lo:400: 00000100:00100000:3.0:1784755955.481527:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f211847d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+11:3303:x1871452190018688:12345-0@lo:400: Request processed in 34us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755955.481532:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784755955.481553:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f43980dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1871452190018816:0@lo:38: 00000100:00100000:3.0:1784755955.481574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755955.481624:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073ac9f96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190018688:0@lo:400: 00000100:00100000:3.0:1784755955.481653:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190018816 00000100:00100000:3.0:1784755955.481655:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190018816 00000100:00100000:3.0:1784755955.481668:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784755955.481671:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000db771a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1871452190018816:12345-0@lo:38: 00010000:00080000:3.0:1784755955.481687:0:5783:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:3.0:1784755955.481713:0:5783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbe94f39231c84ce3 00000004:00100000:3.0:1784755955.481770:0:5783:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784755955.481887:0:5783:0:(import.c:65:import_set_state_nolock()) 00000000ff4ee76f : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784755955.481916:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000db771a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1871452190018816:12345-0@lo:38: Request processed in 245us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755955.481930:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784755955.481948:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f43980dd x1871452190018816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784755965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784755955.481957:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784755955.481962:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784755955.482353:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784755955.482356:0:3299:0:(import.c:65:import_set_state_nolock()) 000000004d2f5ccd lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784755955.482361:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f43980dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1871452190018816:0@lo:38: 10000000:01000000:3.0:1784755955.993086:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784755955.993095:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff96f18794d800 from 3 10000000:01000000:3.0:1784755955.993100:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784755955.993146:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: 00000000f35c538e/0xbe94f39231c84cea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755955.993159:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: 00000000f35c538e/0xbe94f39231c84cea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755955.993187:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: 00000000f35c538e/0xbe94f39231c84cea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755955.993209:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ec35243f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190018944:0@lo:101: 00000100:00100000:3.0:1784755955.993275:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755955.993543:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190018944 00000100:00100000:0.0:1784755955.993552:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190018944 00000100:00100000:3.0:1784755955.993673:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e042397c going to sleep for 11 seconds 00010000:00010000:3.0:1784755955.993720:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755955.993777:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784755955.993786:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0fbdcb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+11:5779:x1871452190018944:12345-0@lo:101: 00010000:00010000:0.0:1784755955.993801:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755955.993813:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e36946fd/0xbe94f39231c84cf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84cea expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755955.993861:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e36946fd/0xbe94f39231c84cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84cea expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755955.993871:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e36946fd/0xbe94f39231c84cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84cea expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755955.993880:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e36946fd, rc 0) 00000100:00100000:0.0:1784755955.993934:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0fbdcb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:5779:x1871452190018944:12345-0@lo:101: Request processed in 150us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755955.993940:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784755955.994015:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ec35243f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190018944:0@lo:101: 00010000:00010000:3.0:1784755955.994028:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: 00000000f35c538e/0xbe94f39231c84cea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755955.994036:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: 00000000f35c538e/0xbe94f39231c84cea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755955.994083:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ec35243f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190019072:0@lo:256: 00000100:00100000:3.0:1784755955.994112:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755955.994278:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e042397c going to sleep for 11 seconds 00000100:00100000:1.0:1784755955.994319:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190019072 00000100:00100000:1.0:1784755955.994324:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190019072 00000100:00100000:1.0:1784755955.994358:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784755955.994365:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e665a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:5779:x1871452190019072:12345-0@lo:256: 20000000:01000000:1.0:1784755955.994381:0:5776:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784755955.994397:0:5776:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784755955.994574:0:5776:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1784755955.994692:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e665a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:5779:x1871452190019072:12345-0@lo:256: Request processed in 328us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755955.994700:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784755955.994886:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ec35243f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190019072:0@lo:256: 10000000:01000000:2.0:1784755955.994931:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784755955.994939:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: 00000000f35c538e/0xbe94f39231c84cea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755955.994949:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: 00000000f35c538e/0xbe94f39231c84cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755957.019424:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784755957.772864:0:6260:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff15277a20 20000000:00000080:2.0:1784755957.772882:0:6260:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96f1abd13400 uarg=0000000000000000 20000000:01000000:2.0:1784755957.772913:0:6260:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1784755957.772920:0:6260:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1784755957.772925:0:6260:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1784755957.773177:0:6260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1784755957.773188:0:6260:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1784755957.788036:0:6260:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784755957.789454:0:6260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784755957.789528:0:6260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1784755957.789656:0:6260:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1784755957.789676:0:6260:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784755957.789752:0:6260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755957.789777:0:6260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f923b454/0xbe94f39231c84cb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84cb2 expref: 11 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755957.789785:0:6260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755957.789822:0:6260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f923b454/0xbe94f39231c84cb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84cb2 expref: 11 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755957.789899:0:6260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f923b454/0xbe94f39231c84cb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84cb2 expref: 11 pid: 5774 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755957.789913:0:6260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099b06457 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6260:1871452190019200:0@lo:104: 00000100:00100000:2.0:1784755957.789976:0:6260:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755957.790086:0:6260:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a2a104d9 going to sleep for 11 seconds 00000100:00100000:1.0:1784755957.790162:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190019200 00000100:00100000:1.0:1784755957.790170:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190019200 00000100:00100000:1.0:1784755957.790374:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784755957.790384:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a78a92c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9117e42-6e26-4b4a-b619-3540b762413c+3:6260:x1871452190019200:12345-0@lo:104: 00010000:00010000:1.0:1784755957.790396:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755957.790514:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784755957.790519:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a78a92c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9117e42-6e26-4b4a-b619-3540b762413c+3:6260:x1871452190019200:12345-0@lo:104: Request processed in 138us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755957.790527:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1784755957.790582:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784755957.790588:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790595:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e1c92b8e already unused, calling callback (00000000dd063f9b) 10000000:00010000:0.0:1784755957.790598:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790604:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755957.790623:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755957.790628:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784755957.790659:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790666:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755957.790684:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790691:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: 00000000e1c92b8e/0xbe94f39231c84cb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cb9 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790708:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755957.790709:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755957.790710:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755957.790729:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d13a09c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190019328:0@lo:103: 00000100:00100000:0.0:1784755957.790760:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755957.790796:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190019328 00000100:00100000:0.0:1784755957.790800:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190019328 00010000:00010000:0.0:1784755957.790816:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f923b454/0xbe94f39231c84cb9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84cb2 expref: 12 pid: 5774 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755957.790856:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784755957.790862:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c92b08e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+12:3303:x1871452190019328:12345-0@lo:103: 00010000:00010000:0.0:1784755957.790872:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755957.790876:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f923b454/0xbe94f39231c84cb9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84cb2 expref: 12 pid: 5774 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790892:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f923b454/0xbe94f39231c84cb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84cb2 expref: 12 pid: 5774 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790906:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790912:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790923:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790929:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790934:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790938:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790942:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f9d8fcd1 already unused, calling callback (00000000168e3e73) 00010000:00010000:0.0:1784755957.790944:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790950:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790956:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755957.790975:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755957.791001:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c92b08e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+12:3303:x1871452190019328:12345-0@lo:103: Request processed in 140us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755957.791007:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784755957.791039:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d13a09c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190019328:0@lo:103: 00010000:00010000:3.0:1784755957.791499:0:6260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f923b454/0xbe94f39231c84cb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84cb2 expref: 11 pid: 5774 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755957.791513:0:6260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099b06457 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6260:1871452190019200:0@lo:104: 00010000:00010000:3.0:1784755957.791526:0:6260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755957.791534:0:6260:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755957.791678:0:6260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755957.791684:0:6260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f9d8fcd1/0xbe94f39231c84cf8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755958.042083:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755959.065256:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755960.093272:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755960.601018:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000b1c01d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190019584:0@lo:400: 00000100:00100000:2.0:1784755960.601053:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d13a09c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190019456:0@lo:400: 00000100:00100000:0.0:1784755960.601079:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755960.601101:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755960.601160:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190019584 00000100:00100000:2.0:1784755960.601168:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190019584 00000100:00100000:3.0:1784755960.601203:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190019456 00000100:00100000:3.0:1784755960.601208:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190019456 00000100:00100000:2.0:1784755960.601220:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784755960.601231:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c55fe131 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190019584:12345-0@lo:400: 00000100:00100000:3.0:1784755960.601234:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784755960.601244:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fcf87c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+11:3300:x1871452190019456:12345-0@lo:400: 00000100:00100000:3.0:1784755960.601285:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fcf87c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+11:3300:x1871452190019456:12345-0@lo:400: Request processed in 43us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755960.601296:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c55fe131 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190019584:12345-0@lo:400: Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755960.601297:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784755960.601308:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784755960.601355:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d13a09c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190019456:0@lo:400: 00010000:00080000:2.0:1784755960.601362:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000b1c01d4 x1871452190019584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755960.601373:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000b1c01d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190019584:0@lo:400: 00010000:00010000:3.0:1784755961.117938:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784755962.000207:0:6577:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784755962.000212:0:6577:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1784755962.000476:0:6577:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000002e2ece74 00000020:01000004:3.0:1784755962.000492:0:6577:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1784755962.000505:0:6577:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784755962.000518:0:6577:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000d0d6959c) 00000020:00000080:3.0:1784755962.000534:0:6577:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784755962.017574:0:6577:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1784755962.018573:0:6577:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1784755962.042030:0:6577:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1784755962.046949:0:6577:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1784755962.046985:0:6577:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1784755962.047040:0:6577:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1784755962.047068:0:6577:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1784755962.047506:0:6577:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1784755962.047516:0:6577:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784755962.047526:0:6577:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbe94f39231c84d06 00000020:01000004:0.0:1784755962.047532:0:6577:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1784755962.047551:0:6577:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.121@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784755962.047554:0:6577:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784755962.047559:0:6577:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1784755962.047563:0:6577:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1784755962.047573:0:6577:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000babf8199) 00000020:00000080:0.0:1784755962.047582:0:6577:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1784755962.048757:0:6577:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784755962.049052:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1784755962.049064:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1784755962.051722:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1784755962.051734:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784755962.052064:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784755962.052070:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1784755962.057612:0:6577:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755962.057784:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1784755962.057790:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1784755962.059191:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1784755962.059207:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1784755962.084516:0:6577:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784755962.084758:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784755962.084765:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1784755962.087118:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784755962.087131:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1784755962.087967:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784755962.087975:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1784755962.091260:0:6577:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784755962.091545:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1784755962.091552:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1784755962.092269:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1784755962.095117:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1784755962.131964:0:6577:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784755962.132170:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1784755962.132177:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1784755962.134473:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1784755962.134483:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1784755962.135037:0:6577:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1784755962.135060:0:6577:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1784755962.135065:0:6577:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:2.0:1784755962.137009:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1784755962.152588:0:6577:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.121@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784755962.152624:0:6577:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.121@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1784755962.152629:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784755962.152631:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784755962.152633:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755962.152635:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784755962.152636:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755962.152637:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755962.152639:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784755962.152640:0:6577:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784755962.152642:0:6577:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784755962.152643:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755962.152644:0:6577:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784755962.152648:0:6577:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1784755962.152650:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784755962.152652:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784755962.152653:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755962.152654:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784755962.152655:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755962.152656:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755962.152656:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784755962.152657:0:6577:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784755962.152663:0:6577:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784755962.152663:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755962.152664:0:6577:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784755962.152691:0:6577:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784755962.152707:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084e3e089 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190019712:0@lo:253: 00000100:00100000:0.0:1784755962.152771:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755962.152919:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190019712 00000100:00100000:3.0:1784755962.152928:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190019712 00000100:00100000:3.0:1784755962.152979:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784755962.152987:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ab15380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190019712:12345-0@lo:253: 20000000:01000000:3.0:1784755962.153025:0:5777:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784755962.153028:0:5777:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1784755962.153033:0:5777:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1784755962.153035:0:5777:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1784755962.153994:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784755962.154185:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1784755962.154200:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1784755962.154237:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1784755962.154245:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1784755962.154275:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1784755962.154325:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1784755962.154687:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1784755962.154705:0:5777:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.121@tcp 20000000:01000000:3.0:1784755962.154707:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.121@tcp (null) (null) (null) 00000040:00080000:3.0:1784755962.154739:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1784755962.154746:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784755962.154793:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1784755962.154802:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.121@tcp (null) (null) 00000040:00080000:3.0:1784755962.154858:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1784755962.154869:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784755962.154902:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1784755962.154950:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1784755962.155656:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1784755962.155672:0:5777:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.121@tcp 20000000:01000000:3.0:1784755962.155674:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.121@tcp (null) (null) (null) 00000040:00080000:3.0:1784755962.155705:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1784755962.155711:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784755962.155737:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1784755962.155743:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.121@tcp (null) (null) 00000040:00080000:3.0:1784755962.155782:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1784755962.155790:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784755962.155864:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1784755962.155916:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1784755962.155931:0:5777:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784755962.155934:0:5777:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784755962.155938:0:5777:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784755962.155947:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784755962.155950:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1784755962.155981:0:5777:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784755962.155983:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000100:00100000:0.0:1784755962.156182:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d976df40 going to sleep for 11 seconds 20000000:01000000:3.0:1784755962.157146:0:6592:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1784755962.157202:0:6592:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1784755962.157252:0:6592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1784755962.157544:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1784755962.157587:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1784755962.157642:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1784755962.157656:0:5777:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784755962.157658:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784755962.158249:0:6593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1784755962.158292:0:6593:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1784755962.158335:0:6593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1784755962.158574:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1784755962.158613:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1784755962.158647:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1784755962.158658:0:5777:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784755962.158660:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784755962.159176:0:6594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1784755962.159372:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1784755962.159410:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1784755962.159482:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1784755962.159499:0:5777:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1784755962.159501:0:5777:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1784755962.159510:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784755962.159530:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.159551:0:5777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84c34 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.159558:0:5777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000aff315cb/0xbe94f39231c84c57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84c50 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.159564:0:5777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000028597df3/0xbe94f39231c84cc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84cc0 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.159581:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.159624:0:5777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000028597df3/0xbe94f39231c84cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84cc0 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.159640:0:5777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000028597df3/0xbe94f39231c84cc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84cc0 expref: 11 pid: 5776 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755962.159655:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009cb5695 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5777:1871452190019840:0@lo:104: 00000100:00100000:0.0:1784755962.159728:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784755962.159822:0:5777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000aff315cb/0xbe94f39231c84c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84c50 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.159830:0:5777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000aff315cb/0xbe94f39231c84c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84c50 expref: 11 pid: 5777 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755962.160021:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000b407a19 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5777:1871452190019968:0@lo:104: 00000100:00100000:2.0:1784755962.160124:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190019840 00000100:00100000:2.0:1784755962.160132:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190019840 00000100:00100000:2.0:1784755962.160177:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784755962.160186:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074a5da2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:5777:x1871452190019840:12345-0@lo:104: 00010000:00010000:2.0:1784755962.160196:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.160253:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784755962.160259:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074a5da2b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:5777:x1871452190019840:12345-0@lo:104: Request processed in 74us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.160265:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1784755962.160363:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784755962.160369:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.160376:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005431e230 already unused, calling callback (00000000dd063f9b) 10000000:00010000:0.0:1784755962.160379:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.160387:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755962.160406:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755962.160412:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784755962.160446:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.160454:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755962.160493:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.160500:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: 000000005431e230/0xbe94f39231c84cc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cc7 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.160512:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755962.160514:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755962.160515:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755962.160523:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784755962.160534:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000967943db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190020096:0@lo:103: 00000100:00100000:0.0:1784755962.160561:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755962.160598:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190020096 00000100:00100000:0.0:1784755962.160601:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190020096 00010000:00010000:0.0:1784755962.160618:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000028597df3/0xbe94f39231c84cc7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84cc0 expref: 12 pid: 5776 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755962.160638:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755962.160645:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000116281e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+12:3303:x1871452190020096:12345-0@lo:103: 00010000:00010000:0.0:1784755962.160654:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755962.160658:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000028597df3/0xbe94f39231c84cc7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84cc0 expref: 12 pid: 5776 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.160672:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000028597df3/0xbe94f39231c84cc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84cc0 expref: 12 pid: 5776 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.160685:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755962.160712:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000116281e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+12:3303:x1871452190020096:12345-0@lo:103: Request processed in 67us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755962.160718:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755962.160756:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000967943db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190020096:0@lo:103: 00000100:00100000:3.0:1784755962.161068:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784755962.161135:0:5777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84c34 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.161144:0:5777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84c34 expref: 11 pid: 5776 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755962.161153:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5777:1871452190020224:0@lo:104: 00000100:00100000:3.0:1784755962.161173:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755962.161232:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 000000008db794e3 going to sleep for 11 seconds 00010000:00010000:3.0:1784755962.161244:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000028597df3/0xbe94f39231c84cc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84cc0 expref: 11 pid: 5776 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755962.161254:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009cb5695 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5777:1871452190019840:0@lo:104: 00000100:00100000:2.0:1784755962.161316:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190019968 00000100:00100000:2.0:1784755962.161321:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190019968 00000100:00100000:2.0:1784755962.161339:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190020224 00000100:00100000:2.0:1784755962.161342:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190020224 00000100:00100000:2.0:1784755962.161352:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755962.161358:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075cf6f3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+4:5777:x1871452190019968:12345-0@lo:104: 00010000:00010000:2.0:1784755962.161365:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161471:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784755962.161476:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075cf6f3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+4:5777:x1871452190019968:12345-0@lo:104: Request processed in 119us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.161482:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755962.161496:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755962.161501:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9ec6cb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:5777:x1871452190020224:12345-0@lo:104: 00010000:00010000:2.0:1784755962.161507:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161539:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784755962.161543:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9ec6cb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:5777:x1871452190020224:12345-0@lo:104: Request processed in 44us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.161549:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1784755962.161563:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784755962.161566:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161574:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000048aa6d67 already unused, calling callback (00000000dd063f9b) 10000000:00010000:2.0:1784755962.161576:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161582:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755962.161588:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755962.161592:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755962.161618:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161624:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755962.161637:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161642:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: 0000000048aa6d67/0xbe94f39231c84c50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84c57 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161653:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784755962.161655:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161660:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003fbd5f97 already unused, calling callback (00000000dd063f9b) 10000000:00010000:2.0:1784755962.161662:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161667:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755962.161672:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755962.161676:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755962.161686:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161693:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755962.161711:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161726:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: 000000003fbd5f97/0xbe94f39231c84c34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84c3b expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.161738:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755962.161739:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755962.161741:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755962.161747:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784755962.161755:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004dd97edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190020480:0@lo:103: 00000100:00100000:2.0:1784755962.161779:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.161806:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190020480 00000100:00100000:2.0:1784755962.161809:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190020480 00010000:00010000:2.0:1784755962.162082:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84c34 expref: 11 pid: 5776 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755962.162103:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755962.162109:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012f7d73c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+11:3301:x1871452190020480:12345-0@lo:103: 00010000:00010000:2.0:1784755962.162117:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755962.162119:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84c34 expref: 11 pid: 5776 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162126:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84c34 expref: 11 pid: 5776 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162138:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755962.162162:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012f7d73c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+11:3301:x1871452190020480:12345-0@lo:103: Request processed in 54us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.162168:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755962.162197:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004dd97edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190020480:0@lo:103: 00000100:00100000:2.0:1784755962.162225:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190020352:0@lo:103: 00000100:00100000:2.0:1784755962.162248:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.162271:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190020352 00000100:00100000:2.0:1784755962.162275:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190020352 00010000:00010000:2.0:1784755962.162286:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000aff315cb/0xbe94f39231c84c57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84c50 expref: 11 pid: 5777 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755962.162304:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755962.162308:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dd97edb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+11:3303:x1871452190020352:12345-0@lo:103: 00010000:00010000:2.0:1784755962.162315:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755962.162317:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000aff315cb/0xbe94f39231c84c57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84c50 expref: 11 pid: 5777 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162325:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000aff315cb/0xbe94f39231c84c57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84c50 expref: 11 pid: 5777 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162336:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162343:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162356:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162363:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162368:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162383:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162388:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000642c7687 already unused, calling callback (00000000168e3e73) 00010000:00010000:2.0:1784755962.162391:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162397:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162405:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.162414:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755962.162439:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dd97edb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+11:3303:x1871452190020352:12345-0@lo:103: Request processed in 131us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.162445:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755962.162483:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190020352:0@lo:103: 00010000:00010000:0.0:1784755962.162549:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755962.162748:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aff315cb/0xbe94f39231c84c57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84c50 expref: 10 pid: 5777 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755962.162766:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000b407a19 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5777:1871452190019968:0@lo:104: 00010000:00010000:3.0:1784755962.162787:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f8a6f1b/0xbe94f39231c84c3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84c34 expref: 9 pid: 5776 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755962.162795:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5777:1871452190020224:0@lo:104: 00010000:00010000:3.0:1784755962.162811:0:5777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.162819:0:5777:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.162824:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.162829:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000642c7687/0xbe94f39231c84d14 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784755962.163085:0:5777:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1784755962.204424:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ab15380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+8:6577:x1871452190019712:12345-0@lo:253: Request processed in 51429us (51645us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755962.204440:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784755962.204617:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084e3e089 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190019712:0@lo:253: 10000000:01000000:0.0:1784755962.204632:0:6577:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784755962.204635:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784755962.204637:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784755962.204639:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755962.204640:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1784755962.204641:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755962.204642:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755962.204644:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784755962.204645:0:6577:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784755962.204646:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755962.204648:0:6577:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784755962.204668:0:6577:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002e2ece74 from lustre-OST0000 10000000:01000000:0.0:1784755962.204716:0:6577:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1784755962.204719:0:6577:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784755962.204725:0:6577:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96f185184d40 local copy 10000000:01000000:0.0:1784755962.204729:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784755962.204763:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.204773:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.204788:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755962.204805:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084e3e089 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190020608:0@lo:101: 00000100:00100000:0.0:1784755962.204871:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.204996:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190020608 00000100:00100000:2.0:1784755962.205004:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190020608 00000100:00100000:2.0:1784755962.205049:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784755962.205057:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006510d89f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+8:6577:x1871452190020608:12345-0@lo:101: 00010000:00010000:2.0:1784755962.205069:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755962.205082:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006a98af2d/0xbe94f39231c84d22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84d1b expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.205104:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006a98af2d/0xbe94f39231c84d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84d1b expref: 9 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.205126:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006a98af2d/0xbe94f39231c84d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d1b expref: 9 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.205134:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006a98af2d, rc 0) 00000100:00100000:2.0:1784755962.205163:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006510d89f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+9:6577:x1871452190020608:12345-0@lo:101: Request processed in 108us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.205169:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784755962.205402:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000003ef91200 going to sleep for 11 seconds 00000100:00100000:0.0:1784755962.205418:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084e3e089 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190020608:0@lo:101: 00010000:00010000:0.0:1784755962.205431:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.205439:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755962.205562:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084e3e089 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190020736:0@lo:501: 00000100:00100000:0.0:1784755962.205588:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755962.205600:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000003ef91200 going to sleep for 11 seconds 00000100:00100000:3.0:1784755962.205665:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190020736 00000100:00100000:3.0:1784755962.205669:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190020736 00000100:00100000:3.0:1784755962.205739:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784755962.205746:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077b9c877 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+9:6577:x1871452190020736:12345-0@lo:501: 00000100:00100000:0.0:1784755962.206376:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077b9c877 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+9:6577:x1871452190020736:12345-0@lo:501: Request processed in 629us (786us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784755962.206385:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784755962.206455:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084e3e089 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190020736:0@lo:501: 10000000:01000000:3.0:1784755962.206481:0:6577:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784755962.206527:0:6577:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784755962.206533:0:6577:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.206542:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.206547:0:6577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.206566:0:6577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784755962.206586:0:6577:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96f1bc39f800 10000000:01000000:3.0:1784755962.206591:0:6577:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784755962.206596:0:6577:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff96f185184d40 10000000:01000000:3.0:1784755962.206598:0:6577:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784755962.206601:0:6577:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff96f185184d40 from 1 10000000:01000000:3.0:1784755962.206604:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784755962.206625:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: 000000008671370d/0xbe94f39231c84d29 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.206633:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: 000000008671370d/0xbe94f39231c84d29 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.206640:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: 000000008671370d/0xbe94f39231c84d29 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755962.206652:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190020864:0@lo:101: 00000100:00100000:3.0:1784755962.206681:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784755962.207151:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784755962.207157:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755962.207165:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ca7f3298 already unused, calling callback (00000000dd063f9b) 10000000:00010000:1.0:1784755962.207168:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755962.207175:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784755962.207181:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755962.207194:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784755962.207213:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755962.207219:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784755962.207237:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755962.207244:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: 00000000ca7f3298/0xbe94f39231c84d1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbe94f39231c84d22 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755962.207258:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755962.207260:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755962.207261:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755962.207269:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784755962.207291:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007394648f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190020992:0@lo:103: 00000100:00100000:1.0:1784755962.207322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755962.207537:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000003275a8ed going to sleep for 11 seconds 00000100:00100000:2.0:1784755962.207546:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190020864 00000100:00100000:2.0:1784755962.207552:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190020864 00000100:00100000:2.0:1784755962.207584:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784755962.207590:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db0c8741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+9:6577:x1871452190020864:12345-0@lo:101: 00010000:00010000:2.0:1784755962.207600:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755962.207613:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000011cc88/0xbe94f39231c84d30 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84d29 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.207635:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000011cc88/0xbe94f39231c84d30 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84d29 expref: 10 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.207645:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000011cc88/0xbe94f39231c84d30 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d29 expref: 10 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.207653:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000011cc88, rc 0) 00000100:00100000:2.0:1784755962.207694:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db0c8741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+10:6577:x1871452190020864:12345-0@lo:101: Request processed in 104us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.207700:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784755962.207730:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190020992 00000100:00100000:2.0:1784755962.207733:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190020992 00000100:00100000:2.0:1784755962.207759:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784755962.207762:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190020864:0@lo:101: 00000100:00100000:2.0:1784755962.207772:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c96d6964 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+10:3300:x1871452190020992:12345-0@lo:103: 00010000:00010000:3.0:1784755962.207777:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: 000000008671370d/0xbe94f39231c84d29 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d30 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.207780:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784755962.207785:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: 000000008671370d/0xbe94f39231c84d29 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84d30 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.207788:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006a98af2d/0xbe94f39231c84d22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbe94f39231c84d1b expref: 10 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755962.207799:0:6577:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784755962.207799:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784755962.207809:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: 000000008671370d/0xbe94f39231c84d29 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d30 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.207815:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: 000000008671370d/0xbe94f39231c84d29 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d30 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755962.207822:0:6577:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 00000100:00100000:2.0:1784755962.207823:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c96d6964 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+9:3300:x1871452190020992:12345-0@lo:103: Request processed in 52us (502us total) trans 0 rc 0/0 10000000:01000000:3.0:1784755962.207826:0:6577:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000100:00100000:2.0:1784755962.207828:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 10000000:01000000:3.0:1784755962.207830:0:6577:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784755962.207848:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784755962.207861:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.207867:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755962.207882:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007394648f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190020992:0@lo:103: 00010000:00010000:3.0:1784755962.207887:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755962.207906:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021120:0@lo:101: 00000100:00100000:3.0:1784755962.207930:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755962.207946:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000003275a8ed going to sleep for 11 seconds 00000100:00100000:2.0:1784755962.207977:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190021120 00000100:00100000:2.0:1784755962.207981:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190021120 00000100:00100000:2.0:1784755962.208001:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784755962.208006:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000610211d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+9:6577:x1871452190021120:12345-0@lo:101: 00010000:00010000:2.0:1784755962.208012:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755962.208018:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009bc0da53/0xbe94f39231c84d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84d37 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.208029:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009bc0da53/0xbe94f39231c84d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84d37 expref: 10 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.208036:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009bc0da53/0xbe94f39231c84d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d37 expref: 10 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.208041:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009bc0da53, rc 0) 00000100:00100000:2.0:1784755962.208077:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000610211d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+10:6577:x1871452190021120:12345-0@lo:101: Request processed in 71us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.208082:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784755962.208238:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021120:0@lo:101: 00010000:00010000:3.0:1784755962.208251:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.208258:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755962.208332:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021248:0@lo:501: 00000100:00100000:3.0:1784755962.208361:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755962.208418:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000003275a8ed going to sleep for 11 seconds 00000100:00100000:2.0:1784755962.208465:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190021248 00000100:00100000:2.0:1784755962.208469:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190021248 00000100:00100000:2.0:1784755962.208499:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784755962.208504:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048af6205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+10:6577:x1871452190021248:12345-0@lo:501: 00000100:00100000:2.0:1784755962.208809:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048af6205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+10:6577:x1871452190021248:12345-0@lo:501: Request processed in 304us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.208817:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784755962.208962:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021248:0@lo:501: 00000100:00100000:3.0:1784755962.208986:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021376:0@lo:503: 00000100:00100000:3.0:1784755962.209023:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755962.209050:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000003275a8ed going to sleep for 11 seconds 00000100:00100000:1.0:1784755962.209117:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190021376 00000100:00100000:1.0:1784755962.209121:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190021376 00000100:00100000:1.0:1784755962.209150:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784755962.209157:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5af11a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+10:6577:x1871452190021376:12345-0@lo:503: 00000100:00100000:1.0:1784755962.209297:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5af11a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+10:6577:x1871452190021376:12345-0@lo:503: Request processed in 141us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755962.209303:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784755962.209367:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021376:0@lo:503: 00000040:00080000:3.0:1784755962.209742:0:6577:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784755962.210226:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021504:0@lo:502: 00000100:00100000:3.0:1784755962.210270:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755962.210335:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000003275a8ed going to sleep for 11 seconds 00000100:00100000:2.0:1784755962.210379:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190021504 00000100:00100000:2.0:1784755962.210384:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190021504 00000100:00100000:2.0:1784755962.210448:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784755962.210456:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f76ada8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+10:6577:x1871452190021504:12345-0@lo:502: 00000100:00100000:2.0:1784755962.210642:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f76ada8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+10:6577:x1871452190021504:12345-0@lo:502: Request processed in 187us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.210649:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784755962.210718:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021504:0@lo:502: 00000040:00080000:3.0:1784755962.211000:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784755962.211047:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784755962.211079:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784755962.211122:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784755962.211158:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784755962.211190:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784755962.211212:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021632:0@lo:502: 00000100:00100000:3.0:1784755962.211254:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755962.212073:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190021632 00000100:00100000:3.0:1784755962.212084:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 000000003275a8ed going to sleep for 11 seconds 00000100:00100000:1.0:1784755962.212118:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190021632 00000100:00100000:1.0:1784755962.212150:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784755962.212156:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae8a4e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+10:6577:x1871452190021632:12345-0@lo:502: 00000100:00100000:1.0:1784755962.212325:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae8a4e4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+10:6577:x1871452190021632:12345-0@lo:502: Request processed in 169us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755962.212333:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784755962.212429:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067bae39e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021632:0@lo:502: 00000040:00080000:3.0:1784755962.212538:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784755962.212548:0:6577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1784755962.213450:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784755962.213469:0:6595:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1784755962.213475:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755962.213478:0:6595:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784755962.213484:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784755962.213497:0:6595:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000007206b5fa) 00000020:00000080:3.0:1784755962.213516:0:6595:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784755962.213521:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784755962.213593:0:6595:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002e2ece74 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784755962.213601:0:6595:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784755962.213607:0:6595:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbe94f39231c84d4c 00010000:00010000:2.0:1784755962.218791:0:6595:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1784755962.219206:0:6595:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1784755962.222131:0:6595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1784755962.222439:0:6595:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1784755962.230078:0:6595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1784755962.230617:0:6595:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1784755962.232058:0:6595:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1784755962.232073:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755962.232080:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755962.232082:0:6595:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1784755962.232086:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784755962.232090:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755962.232091:0:6595:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784755962.232094:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784755962.232096:0:6595:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784755962.232145:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755962.232149:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755962.232150:0:6595:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784755962.232153:0:6595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1784755962.232365:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1784755962.232388:0:6577:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784755962.232412:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84d37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.232424:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: 00000000e23bbbe2/0xbe94f39231c84d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755962.232433:0:6577:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96f1bc39f800 from 1 10000000:01000000:2.0:1784755962.232436:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784755962.232482:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: 000000006a98af2d/0xbe94f39231c84d53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.232496:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: 000000006a98af2d/0xbe94f39231c84d53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.232507:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: 000000006a98af2d/0xbe94f39231c84d53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755962.232530:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021760:0@lo:101: 00000100:00100000:2.0:1784755962.232597:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.232641:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0233ce0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755962.232715:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190021760 00000100:00100000:0.0:1784755962.232722:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190021760 00000100:00100000:0.0:1784755962.232764:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784755962.232773:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028f928ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+10:6577:x1871452190021760:12345-0@lo:101: 00010000:00010000:0.0:1784755962.232785:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755962.232799:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca7f3298/0xbe94f39231c84d5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84d53 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.232854:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca7f3298/0xbe94f39231c84d5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84d53 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.232865:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca7f3298/0xbe94f39231c84d5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d53 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.232873:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca7f3298, rc 0) 00000100:00100000:0.0:1784755962.233149:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028f928ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190021760:12345-0@lo:101: Request processed in 377us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755962.233157:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784755962.237984:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021760:0@lo:101: 00010000:00010000:2.0:1784755962.238016:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: 000000006a98af2d/0xbe94f39231c84d53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.238029:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: 000000006a98af2d/0xbe94f39231c84d53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755962.238168:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021888:0@lo:501: 00000100:00100000:2.0:1784755962.238222:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.238265:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0233ce0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755962.239013:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190021888 00000100:00100000:3.0:1784755962.239031:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190021888 00000100:00100000:3.0:1784755962.239069:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784755962.239076:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed42d6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190021888:12345-0@lo:501: 00000100:00100000:3.0:1784755962.239303:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed42d6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190021888:12345-0@lo:501: Request processed in 226us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755962.239311:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784755962.239412:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190021888:0@lo:501: 00000100:00100000:2.0:1784755962.239446:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022016:0@lo:503: 00000100:00100000:2.0:1784755962.239492:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.239550:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0233ce0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755962.240401:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190022016 00000100:00100000:1.0:1784755962.240407:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190022016 00000100:00100000:1.0:1784755962.240449:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784755962.240456:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b52aa9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190022016:12345-0@lo:503: 00000100:00100000:1.0:1784755962.242607:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b52aa9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190022016:12345-0@lo:503: Request processed in 1945us (2908us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755962.242620:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784755962.242737:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022016:0@lo:503: 00000040:00080000:2.0:1784755962.243363:0:6577:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784755962.243471:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022144:0@lo:502: 00000100:00100000:2.0:1784755962.243612:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.243701:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0233ce0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755962.243775:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190022144 00000100:00100000:0.0:1784755962.243782:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190022144 00000100:00100000:0.0:1784755962.243993:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784755962.244001:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebe771fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190022144:12345-0@lo:502: 00000100:00100000:0.0:1784755962.244292:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebe771fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190022144:12345-0@lo:502: Request processed in 292us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755962.244299:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784755962.244421:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022144:0@lo:502: 00000040:00080000:2.0:1784755962.244692:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1784755962.244741:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1784755962.244765:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022272:0@lo:502: 00000100:00100000:2.0:1784755962.244797:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.245326:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b0233ce0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755962.245422:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190022272 00000100:00100000:1.0:1784755962.245428:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190022272 00000100:00100000:1.0:1784755962.245478:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784755962.245485:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089cdcb88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190022272:12345-0@lo:502: 00000100:00100000:1.0:1784755962.245717:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089cdcb88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190022272:12345-0@lo:502: Request processed in 232us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755962.245724:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784755962.245813:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001a2cf9c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022272:0@lo:502: 00000040:00080000:2.0:1784755962.246003:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1784755962.246015:0:6577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1784755962.246754:0:6599:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784755962.246764:0:6599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755962.246767:0:6599:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784755962.246774:0:6599:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96f1bc39f800 00000020:00000080:2.0:1784755962.246776:0:6599:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784755962.246811:0:6599:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784755962.246814:0:6599:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755962.246816:0:6599:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784755962.246819:0:6599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1784755962.247036:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784755962.247056:0:6577:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784755962.247073:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dea00/0xbe94f39231c84d53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.247083:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f1c21dea00/0xbe94f39231c84d53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755962.247124:0:6577:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784755962.247127:0:6577:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96f1bc39f800 10000000:01000000:0.0:1784755962.247130:0:6577:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96f1bc39f800 10000000:01000000:0.0:1784755962.247141:0:6577:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784755962.247148:0:6577:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96f1bc39f800 from 1 10000000:01000000:0.0:1784755962.247151:0:6577:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784755962.247182:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.247190:0:6577:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.247200:0:6577:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755962.247218:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022400:0@lo:101: 00000100:00100000:0.0:1784755962.247261:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755962.247397:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1a0e52e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784755962.247436:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190022400 00000100:00100000:1.0:1784755962.247442:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190022400 00000100:00100000:1.0:1784755962.247597:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784755962.247606:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190022400:12345-0@lo:101: 00010000:00010000:1.0:1784755962.247617:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755962.247630:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84d68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84d61 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755962.247652:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84d61 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755962.247674:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d61 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755962.247683:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21dca00, rc 0) 00000100:00100000:1.0:1784755962.247730:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:6577:x1871452190022400:12345-0@lo:101: Request processed in 125us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755962.247736:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784755962.247801:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022400:0@lo:101: 00010000:00010000:2.0:1784755962.247814:0:6577:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.247823:0:6577:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755962.247923:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022528:0@lo:501: 00000100:00100000:2.0:1784755962.247956:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.248141:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d67600 going to sleep for 11 seconds 00000100:00100000:0.0:1784755962.248168:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190022528 00000100:00100000:0.0:1784755962.248172:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190022528 00000100:00100000:0.0:1784755962.248194:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784755962.248201:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:6577:x1871452190022528:12345-0@lo:501: 00000100:00100000:0.0:1784755962.248611:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:6577:x1871452190022528:12345-0@lo:501: Request processed in 408us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755962.248618:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784755962.248713:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022528:0@lo:501: 00000100:00100000:2.0:1784755962.248741:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022656:0@lo:503: 00000100:00100000:2.0:1784755962.248776:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.248854:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d67600 going to sleep for 11 seconds 00000100:00100000:0.0:1784755962.248966:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190022656 00000100:00100000:0.0:1784755962.248970:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190022656 00000100:00100000:0.0:1784755962.249039:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784755962.249047:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:6577:x1871452190022656:12345-0@lo:503: 00000100:00100000:0.0:1784755962.249190:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:6577:x1871452190022656:12345-0@lo:503: Request processed in 144us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755962.249196:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784755962.249261:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022656:0@lo:503: 00000040:00080000:2.0:1784755962.249549:0:6577:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784755962.249606:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022784:0@lo:502: 00000100:00100000:2.0:1784755962.249639:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.249867:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d67600 going to sleep for 11 seconds 00000100:00100000:1.0:1784755962.249983:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190022784 00000100:00100000:1.0:1784755962.249988:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190022784 00000100:00100000:1.0:1784755962.250011:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784755962.250017:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:6577:x1871452190022784:12345-0@lo:502: 00000100:00100000:1.0:1784755962.250216:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:6577:x1871452190022784:12345-0@lo:502: Request processed in 198us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755962.250223:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784755962.250335:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022784:0@lo:502: 00000040:00080000:2.0:1784755962.250667:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1784755962.250717:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1784755962.250753:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1784755962.250801:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1784755962.250863:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1784755962.251055:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1784755962.251095:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1784755962.251130:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1784755962.251190:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1784755962.251229:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1784755962.251264:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1784755962.251392:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1784755962.251427:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1784755962.251456:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1784755962.251585:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1784755962.251633:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1784755962.251675:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784755962.251718:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784755962.251752:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784755962.251781:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784755962.251818:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784755962.251871:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784755962.251978:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784755962.252027:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784755962.252062:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1784755962.252095:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1784755962.252140:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1784755962.252176:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1784755962.252217:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022912:0@lo:502: 00000100:00100000:2.0:1784755962.252353:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.252388:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d67600 going to sleep for 11 seconds 00000100:00100000:1.0:1784755962.252484:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190022912 00000100:00100000:1.0:1784755962.252490:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190022912 00000100:00100000:1.0:1784755962.252600:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784755962.252608:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:6577:x1871452190022912:12345-0@lo:502: 00000100:00100000:1.0:1784755962.252802:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:6577:x1871452190022912:12345-0@lo:502: Request processed in 194us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755962.252810:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784755962.253110:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd16680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190022912:0@lo:502: 00000040:00080000:2.0:1784755962.253181:0:6577:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1784755962.253191:0:6577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1784755962.254235:0:6600:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1784755962.254251:0:6600:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff96f18f83cd40) 00000020:00000080:2.0:1784755962.254340:0:6600:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1784755962.254639:0:6600:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96f1bc39f800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784755962.254644:0:6600:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96f1bc39f800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784755962.254647:0:6600:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96f1bc39f800 3 00010000:00080000:2.0:1784755962.254683:0:6600:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96f1bf859000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.121@tcp at head 00010000:00010000:2.0:1784755962.256786:0:6600:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1784755962.257063:0:6600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1784755962.257098:0:6600:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784755962.257110:0:6600:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbe94f39231c84d76 00000100:00080000:2.0:1784755962.257120:0:6600:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784755962.257132:0:6600:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96f1bf859000 using connection 192.168.204.121@tcp/0@lo 00000100:00100000:2.0:1784755962.257168:0:6600:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96f1bbd16680 x1871452190023040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784755962.257246:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1871452190023040:0@lo:38: 00000100:00100000:0.0:1784755962.257383:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784755962.257465:0:6600:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784755962.257497:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190023040 00000100:00100000:3.0:1784755962.257504:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190023040 00000100:00100000:3.0:1784755962.257538:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784755962.257545:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1871452190023040:12345-0@lo:38: 00010000:00080000:3.0:1784755962.257567:0:5781:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:3.0:1784755962.257596:0:5781:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbe94f39231c84d7d 00000100:00100000:2.0:1784755962.257604:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1871452190023168:0@lo:400: 00000004:00100000:3.0:1784755962.257611:0:5781:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784755962.257630:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784755962.257640:0:5781:0:(import.c:65:import_set_state_nolock()) ffff96f1bf810000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784755962.257665:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784755962.257672:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1784755962.258157:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190023168 00000100:00100000:2.0:1784755962.258175:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190023168 00000100:00100000:2.0:1784755962.258200:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784755962.258207:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784755962.258214:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1871452190023168:12345-0@lo:400: 00000100:00100000:2.0:1784755962.258253:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1871452190023168:12345-0@lo:400: Request processed in 40us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.258260:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784755962.260996:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96f1bbd14700 x1871452190023168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755962.261018:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1871452190023168:0@lo:400: 00000040:00080000:2.0:1784755962.261194:0:6600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1784755962.261720:0:6577:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1784755962.261746:0:6577:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784755962.261808:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.261820:0:6577:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784755962.261969:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784755962.261972:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784755962.261973:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755962.261975:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784755962.261976:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755962.261978:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755962.261980:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784755962.261981:0:6577:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784755962.261983:0:6577:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784755962.261984:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755962.261986:0:6577:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784755962.261990:0:6577:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1784755962.261992:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784755962.261994:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784755962.261995:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755962.261996:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784755962.261997:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755962.261998:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755962.261999:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784755962.262000:0:6577:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784755962.262001:0:6577:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784755962.262003:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755962.262004:0:6577:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784755962.262027:0:6577:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784755962.262045:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190023296:0@lo:253: 00000100:00100000:0.0:1784755962.262112:0:6577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755962.262159:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18516bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784755962.262226:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190023296 00000100:00100000:1.0:1784755962.262233:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190023296 00000100:00100000:1.0:1784755962.262270:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784755962.262293:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:6577:x1871452190023296:12345-0@lo:253: 20000000:01000000:1.0:1784755962.262320:0:5777:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784755962.262338:0:5777:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1784755962.263659:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1871452190023040:12345-0@lo:38: Request processed in 6107us (6270us total) trans 0 rc 0/0 00010000:00080000:0.0:1784755962.263660:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96f1bbd16680 x1871452190023040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784755972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755962.263671:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755962.263672:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784755962.263680:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1784755962.263688:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784755962.263692:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784755962.263696:0:3299:0:(import.c:65:import_set_state_nolock()) ffff96f1bf859000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784755962.263702:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1871452190023040:0@lo:38: 20000000:01000000:0.0:1784755962.289602:0:5777:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784755962.289622:0:5777:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1784755962.289675:0:5797:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784755962.289680:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784755962.289700:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.289718:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f180030e00/0xbe94f39231c84cf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84cea expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.289744:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.289781:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f180030e00/0xbe94f39231c84cf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84cea expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.289795:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f180030e00/0xbe94f39231c84cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84cea expref: 12 pid: 5774 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755962.289810:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd14700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5797:1871452190023424:0@lo:104: 00000100:00100000:2.0:1784755962.290141:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.290449:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1879b4600 going to sleep for 11 seconds 00000100:00100000:0.0:1784755962.293485:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190023424 00000100:00100000:0.0:1784755962.293500:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190023424 00000100:00100000:0.0:1784755962.293665:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784755962.293675:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:5797:x1871452190023424:12345-0@lo:104: 00010000:00010000:0.0:1784755962.293692:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f181501800/0xbe94f39231c84cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755962.293875:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784755962.293882:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:5797:x1871452190023424:12345-0@lo:104: Request processed in 209us (3742us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755962.293890:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1784755962.294005:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784755962.294013:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f181501800/0xbe94f39231c84cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294021:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181501800 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:2.0:1784755962.294025:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f181501800/0xbe94f39231c84cea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294034:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f181501800/0xbe94f39231c84cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755962.294042:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f181501800/0xbe94f39231c84cea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755962.294048:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755962.294084:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f181501800/0xbe94f39231c84cea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294101:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755962.294120:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f181501800/0xbe94f39231c84cea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294127:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f181501800/0xbe94f39231c84cea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84cf1 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294143:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755962.294145:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755962.294146:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755962.294177:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190023552:0@lo:103: 00000100:00100000:2.0:1784755962.294217:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755962.294266:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190023552 00000100:00100000:2.0:1784755962.294270:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190023552 00010000:00010000:2.0:1784755962.294301:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f180030e00/0xbe94f39231c84cf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84cea expref: 13 pid: 5774 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755962.294322:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784755962.294328:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f198c14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+13:3303:x1871452190023552:12345-0@lo:103: 00010000:00010000:2.0:1784755962.294337:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755962.294342:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f180030e00/0xbe94f39231c84cf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84cea expref: 13 pid: 5774 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294352:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f180030e00/0xbe94f39231c84cf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84cea expref: 13 pid: 5774 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294368:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294384:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784755962.294398:0:5767:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004718297s 00010000:00010000:2.0:1784755962.294402:0:5767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294408:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294415:0:5767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294421:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294426:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21de000 already unused, calling callback (ffffffffc1436230) 00010000:00010000:2.0:1784755962.294430:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294437:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294444:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755962.294454:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755962.294494:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f198c14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+13:3303:x1871452190023552:12345-0@lo:103: Request processed in 166us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.294501:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784755962.294583:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190023552:0@lo:103: 00010000:00010000:3.0:1784755962.295103:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f180030e00/0xbe94f39231c84cf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84cea expref: 12 pid: 5774 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755962.295116:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd14700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5797:1871452190023424:0@lo:104: 00010000:00010000:3.0:1784755962.295131:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.295140:0:5797:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.295146:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755962.295159:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84d84 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755962.301781:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+11:6577:x1871452190023296:12345-0@lo:253: Request processed in 39480us (39659us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755962.301795:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784755962.301936:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:6577:1871452190023296:0@lo:253: 10000000:01000000:0.0:1784755962.301952:0:6577:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784755962.301955:0:6577:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784755962.301957:0:6577:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784755962.301958:0:6577:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784755962.301960:0:6577:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784755962.301973:0:6577:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784755962.301975:0:6577:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784755962.301976:0:6577:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784755962.301978:0:6577:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784755962.301979:0:6577:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784755962.301981:0:6577:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784755962.301982:0:6577:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784755962.301995:0:6577:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1784755962.306728:0:6577:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1784755962.307033:0:6577:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1784755962.307643:0:6577:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1784755962.307958:0:6577:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1784755962.308163:0:6577:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1784755962.308450:0:6577:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1784755962.309736:0:6577:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1784755962.510898:0:6577:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1784755962.510905:0:6577:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1784755962.510938:0:6577:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784755962.510992:0:6577:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.121@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784755962.511011:0:6577:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1784755962.511034:0:6577:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1784755963.163984:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755964.189197:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784755964.829326:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784755964.829334:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96f18794d800 from 21 10000000:01000000:3.0:1784755964.829339:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784755964.829382:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755964.829395:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755964.829406:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755964.829442:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190023680:0@lo:101: 00000100:00100000:3.0:1784755964.829505:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755964.829560:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1838bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784755964.830766:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190023680 00000100:00100000:1.0:1784755964.830778:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190023680 00000100:00100000:1.0:1784755964.830827:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784755964.830863:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+11:5779:x1871452190023680:12345-0@lo:101: 00010000:00010000:1.0:1784755964.830877:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755964.830892:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21dd800/0xbe94f39231c84d92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84d8b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.831301:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21dd800/0xbe94f39231c84d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84d8b expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.831313:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21dd800/0xbe94f39231c84d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d8b expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.831323:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21dd800, rc 0) 00000100:00100000:1.0:1784755964.831386:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:5779:x1871452190023680:12345-0@lo:101: Request processed in 525us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755964.831393:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784755964.842060:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190023680:0@lo:101: 00010000:00010000:2.0:1784755964.842090:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755964.842103:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755964.842178:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190023808:0@lo:501: 00000100:00100000:2.0:1784755964.842295:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755964.842342:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186922180 going to sleep for 11 seconds 00000100:00100000:0.0:1784755964.842662:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190023808 00000100:00100000:0.0:1784755964.842669:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190023808 00000100:00100000:0.0:1784755964.842723:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784755964.842734:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:5779:x1871452190023808:12345-0@lo:501: 00000100:00100000:0.0:1784755964.843039:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:5779:x1871452190023808:12345-0@lo:501: Request processed in 306us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.843049:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784755964.844074:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd14000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190023808:0@lo:501: 00000100:00100000:1.0:1784755964.844128:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190023936:0@lo:503: 00000100:00100000:1.0:1784755964.844182:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755964.844221:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1bf9b0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784755964.844349:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190023936 00000100:00100000:2.0:1784755964.844357:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190023936 00000100:00100000:2.0:1784755964.844403:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784755964.844422:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:5779:x1871452190023936:12345-0@lo:503: 00000100:00100000:2.0:1784755964.844622:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:5779:x1871452190023936:12345-0@lo:503: Request processed in 201us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755964.844629:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784755964.844711:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190023936:0@lo:503: 00000100:00100000:1.0:1784755964.857301:0:6764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6764:1871452190024064:0@lo:502: 00000100:00100000:1.0:1784755964.857378:0:6764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755964.857440:0:6764:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1bf9b0840 going to sleep for 11 seconds 00000100:00100000:0.0:1784755964.857446:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190024064 00000100:00100000:0.0:1784755964.857452:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190024064 00000100:00100000:0.0:1784755964.857504:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784755964.857513:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:6764:x1871452190024064:12345-0@lo:502: 00000100:00100000:0.0:1784755964.857791:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:6764:x1871452190024064:12345-0@lo:502: Request processed in 278us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.857798:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784755964.858520:0:6764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6764:1871452190024064:0@lo:502: 00000100:00100000:1.0:1784755964.858575:0:6764:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6764:1871452190024192:0@lo:502: 00000100:00100000:1.0:1784755964.858615:0:6764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755964.858650:0:6764:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1bf9b0840 going to sleep for 11 seconds 00000100:00100000:0.0:1784755964.859052:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190024192 00000100:00100000:0.0:1784755964.859058:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190024192 00000100:00100000:0.0:1784755964.859091:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784755964.859099:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:6764:x1871452190024192:12345-0@lo:502: 00000100:00100000:0.0:1784755964.860606:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:6764:x1871452190024192:12345-0@lo:502: Request processed in 1501us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.860618:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784755964.860709:0:6764:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6764:1871452190024192:0@lo:502: 00000040:00080000:1.0:1784755964.860741:0:6764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1784755964.860857:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1784755964.860877:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784755964.860886:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755964.860896:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755964.860925:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784755964.860928:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff96f18794d800 from 4 10000000:01000000:2.0:1784755964.860931:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784755964.860962:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755964.860970:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755964.860979:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755964.861100:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190024320:0@lo:101: 00000100:00100000:2.0:1784755964.861133:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755964.861171:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186922cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755964.861186:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190024320 00000100:00100000:1.0:1784755964.861192:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190024320 00000100:00100000:1.0:1784755964.861226:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784755964.861233:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:5779:x1871452190024320:12345-0@lo:101: 00010000:00010000:1.0:1784755964.861245:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755964.864530:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f180030e00/0xbe94f39231c84da0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84d99 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755964.864575:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f180030e00/0xbe94f39231c84da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84d99 expref: 13 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755964.864588:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f180030e00/0xbe94f39231c84da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d99 expref: 13 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755964.864599:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f180030e00, rc 0) 00000100:00100000:0.0:1784755964.864724:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:5779:x1871452190024320:12345-0@lo:101: Request processed in 3489us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.864733:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784755964.864816:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190024320:0@lo:101: 00010000:00010000:2.0:1784755964.865133:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755964.865144:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755964.865212:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190024448:0@lo:256: 00000100:00100000:2.0:1784755964.865328:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755964.865395:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186922cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755964.865488:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190024448 00000100:00100000:0.0:1784755964.865496:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190024448 00000100:00100000:0.0:1784755964.865542:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784755964.865551:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+13:5779:x1871452190024448:12345-0@lo:256: 20000000:01000000:0.0:1784755964.865570:0:5777:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784755964.865586:0:5777:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784755964.865589:0:5777:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1784755964.865771:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+13:5779:x1871452190024448:12345-0@lo:256: Request processed in 221us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.865787:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784755964.866065:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190024448:0@lo:256: 10000000:01000000:3.0:1784755964.866508:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784755964.866517:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755964.866527:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755964.866537:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784755964.866539:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1784755964.866543:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784755964.866571:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755964.866585:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755964.866594:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755964.866610:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190024576:0@lo:101: 00000100:00100000:3.0:1784755964.866645:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755964.866719:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1838bc300 going to sleep for 11 seconds 00000100:00100000:0.0:1784755964.866763:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190024576 00000100:00100000:0.0:1784755964.866769:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190024576 00000100:00100000:0.0:1784755964.866809:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784755964.866816:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:5779:x1871452190024576:12345-0@lo:101: 00010000:00010000:0.0:1784755964.866825:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755964.867064:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f180031400/0xbe94f39231c84dae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84da7 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755964.867089:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f180031400/0xbe94f39231c84dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84da7 expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755964.867101:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f180031400/0xbe94f39231c84dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84da7 expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755964.867110:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f180031400, rc 0) 00000100:00100000:0.0:1784755964.867181:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190024576:12345-0@lo:101: Request processed in 364us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.867187:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784755964.867448:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190024576:0@lo:101: 00010000:00010000:3.0:1784755964.867461:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755964.867470:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755964.867521:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190024704:0@lo:501: 00000100:00100000:3.0:1784755964.867546:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755964.867611:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1838bc300 going to sleep for 11 seconds 00000100:00100000:0.0:1784755964.867642:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190024704 00000100:00100000:0.0:1784755964.867647:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190024704 00000100:00100000:0.0:1784755964.867677:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784755964.867684:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190024704:12345-0@lo:501: 00000100:00100000:0.0:1784755964.868251:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190024704:12345-0@lo:501: Request processed in 565us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.868259:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784755964.868368:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190024704:0@lo:501: 00000100:00100000:3.0:1784755964.868400:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190024832:0@lo:503: 00000100:00100000:3.0:1784755964.868450:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755964.868512:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1838bc300 going to sleep for 11 seconds 00000100:00100000:0.0:1784755964.868542:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190024832 00000100:00100000:0.0:1784755964.868546:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190024832 00000100:00100000:0.0:1784755964.868572:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784755964.868579:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190024832:12345-0@lo:503: 00000100:00100000:0.0:1784755964.868827:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190024832:12345-0@lo:503: Request processed in 248us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.868851:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784755964.868975:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851cb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190024832:0@lo:503: 00000100:00100000:0.0:1784755964.869562:0:6765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6765:1871452190024960:0@lo:502: 00000100:00100000:0.0:1784755964.869596:0:6765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755964.869657:0:6765:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1a0e39540 going to sleep for 11 seconds 00000100:00100000:3.0:1784755964.869690:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190024960 00000100:00100000:3.0:1784755964.869699:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190024960 00000100:00100000:3.0:1784755964.869720:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784755964.869726:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:6765:x1871452190024960:12345-0@lo:502: 00000100:00100000:3.0:1784755964.870398:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:6765:x1871452190024960:12345-0@lo:502: Request processed in 670us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755964.870420:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784755964.870499:0:6765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6765:1871452190024960:0@lo:502: 00000020:01000000:0.0:1784755964.870524:0:6765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784755964.870532:0:6765:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784755964.870539:0:6765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755964.870541:0:6765:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784755964.870548:0:6765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784755964.870552:0:6765:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.121@tcp to nid 0x20000c0a8cc79 (192.168.204.121@tcp) 00000020:01000000:0.0:1784755964.870573:0:6765:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784755964.870576:0:6765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784755964.870589:0:6765:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff96f185183380) 00000020:00000080:0.0:1784755964.870607:0:6765:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1784755964.870612:0:6765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784755964.870691:0:6765:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784755964.870696:0:6765:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784755964.870703:0:6765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbe94f39231c84dbc 00010000:00080000:0.0:1784755964.870728:0:6765:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96f1bf9ad000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.121@tcp at head 00010000:00010000:0.0:1784755964.871147:0:6765:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1784755964.901288:0:6765:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1784755964.901318:0:6765:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784755964.902123:0:6765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784755964.902358:0:6765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784755964.902421:0:6765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1784755964.902485:0:6765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1784755964.903257:0:6766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784755964.903262:0:6766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784755964.904492:0:6765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784755964.904503:0:6765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784755964.904533:0:6765:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784755964.904559:0:6765:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbe94f39231c84dc3 00000100:00080000:0.0:1784755964.904569:0:6765:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784755964.904575:0:6765:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96f1bf9ad000 using connection 192.168.204.121@tcp/0@lo 00000100:00100000:0.0:1784755964.904608:0:6765:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96f1ae2dc000 x1871452190025088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784755964.904635:0:6765:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784755964.904733:0:6765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755964.904738:0:6765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755964.904740:0:6765:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784755964.904743:0:6765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784755964.904747:0:6765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755964.904749:0:6765:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784755964.904751:0:6765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784755964.904753:0:6765:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784755964.904779:0:6765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6765:1871452190025216:0@lo:502: 00000100:00100000:0.0:1784755964.904873:0:6765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755964.904920:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190025216 00000100:00100000:0.0:1784755964.904928:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190025216 00000100:00100000:0.0:1784755964.904967:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784755964.904976:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f18508b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+14:6765:x1871452190025216:12345-0@lo:502: 00000100:00100000:0.0:1784755964.905315:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f18508b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+14:6765:x1871452190025216:12345-0@lo:502: Request processed in 338us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.905323:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784755964.905378:0:6765:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18390e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784755964.905399:0:6765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6765:1871452190025216:0@lo:502: 00000020:01000000:0.0:1784755964.905435:0:6765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755964.905439:0:6765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755964.905440:0:6765:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784755964.905444:0:6765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1784755964.905675:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1871452190025088:0@lo:8: 00000100:00100000:3.0:1784755964.905713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1784755964.905762:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1784755964.905778:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784755964.905789:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755964.905800:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755964.905809:0:5779:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784755964.905812:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96f18794d800 from 1 10000000:01000000:3.0:1784755964.905814:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784755964.905863:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755964.905872:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755964.905881:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755964.905895:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190025344:0@lo:101: 00000100:00100000:3.0:1784755964.905940:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755964.905961:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1838bcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784755964.906168:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190025088 00000100:00100000:0.0:1784755964.906174:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190025088 00000100:00100000:0.0:1784755964.906205:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784755964.906210:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1871452190025088:12345-0@lo:8: 00010000:00080000:0.0:1784755964.906243:0:6579:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:0.0:1784755964.906268:0:6579:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbe94f39231c84dd1 00002000:00100000:0.0:1784755964.906302:0:6579:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff96f1bf9ab000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784755964.906307:0:6579:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1784755964.906311:0:6579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784755964.906428:0:6579:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784755964.906588:0:6579:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784755964.906611:0:6579:0:(import.c:65:import_set_state_nolock()) ffff96f1bf9ac800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784755964.906669:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1871452190025088:12345-0@lo:8: Request processed in 458us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.906676:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784755964.906814:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1ae2dc000 x1871452190025088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784755974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755964.906825:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784755964.906860:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784755964.906868:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784755964.906881:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784755964.906884:0:3299:0:(import.c:65:import_set_state_nolock()) ffff96f1bf9ad000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784755964.906900:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784755964.906916:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1871452190025088:0@lo:8: 00000004:00080000:1.0:1784755964.906942:0:6766:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784755964.907055:0:6766:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 145073220747ns, next at 0ns, rc = 0 00000100:00100000:1.0:1784755964.907892:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190025344 00000100:00100000:1.0:1784755964.907900:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190025344 00000100:00100000:1.0:1784755964.908124:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784755964.908136:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190025344:12345-0@lo:101: 00010000:00010000:1.0:1784755964.908148:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755964.908165:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21dda00/0xbe94f39231c84dd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84dca expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.908191:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21dda00/0xbe94f39231c84dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84dca expref: 15 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.908202:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21dda00/0xbe94f39231c84dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84dca expref: 15 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.908210:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21dda00, rc 0) 00000100:00100000:1.0:1784755964.908281:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190025344:12345-0@lo:101: Request processed in 148us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755964.908287:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784755964.908335:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190025344:0@lo:101: 00010000:00010000:1.0:1784755964.908351:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.908375:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755964.908444:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190025600:0@lo:501: 00000100:00100000:1.0:1784755964.908474:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755964.908502:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1bf9b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784755964.908516:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190025600 00000100:00100000:1.0:1784755964.908519:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190025600 00000100:00100000:1.0:1784755964.908537:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784755964.908542:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190025600:12345-0@lo:501: 00000100:00100000:1.0:1784755964.908754:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190025600:12345-0@lo:501: Request processed in 211us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755964.908761:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784755964.908790:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190025600:0@lo:501: 00000100:00100000:1.0:1784755964.908816:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190025728:0@lo:503: 00000100:00100000:1.0:1784755964.908871:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755964.908885:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1bf9b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784755964.908896:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190025728 00000100:00100000:1.0:1784755964.908899:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190025728 00000100:00100000:1.0:1784755964.908933:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784755964.908939:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f18508b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190025728:12345-0@lo:503: 00000100:00100000:1.0:1784755964.909512:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f18508b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190025728:12345-0@lo:503: Request processed in 570us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755964.909519:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784755964.909645:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784755964.909747:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190025728:0@lo:503: 00000100:00100000:0.0:1784755964.910232:0:6768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6768:1871452190025984:0@lo:502: 00000100:00100000:0.0:1784755964.910273:0:6768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755964.910307:0:6768:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f19fed3780 going to sleep for 11 seconds 00000100:00100000:1.0:1784755964.910402:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190025984 00000100:00100000:1.0:1784755964.910423:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190025984 00000100:00100000:1.0:1784755964.910459:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784755964.910467:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:6768:x1871452190025984:12345-0@lo:502: 00000100:00100000:1.0:1784755964.910622:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:6768:x1871452190025984:12345-0@lo:502: Request processed in 156us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755964.910629:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784755964.910665:0:6768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6768:1871452190025984:0@lo:502: 00000020:01000000:1.0:1784755964.910689:0:6768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784755964.910698:0:6768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755964.910700:0:6768:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784755964.910706:0:6768:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96f18794d800 00000020:00000080:1.0:1784755964.910708:0:6768:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784755964.910726:0:6768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6768:1871452190026112:0@lo:502: 00000100:00100000:1.0:1784755964.910754:0:6768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755964.910772:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190026112 00000100:00100000:1.0:1784755964.910775:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190026112 00000100:00100000:1.0:1784755964.910792:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784755964.910797:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f18508b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+15:6768:x1871452190026112:12345-0@lo:502: 00000100:00100000:1.0:1784755964.910929:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f18508b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+15:6768:x1871452190026112:12345-0@lo:502: Request processed in 131us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755964.910935:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784755964.910963:0:6768:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1bf9b0540 going to sleep for 11 seconds 00000100:00100000:1.0:1784755964.910974:0:6768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:6768:1871452190026112:0@lo:502: 00000020:01000000:1.0:1784755964.911098:0:6768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755964.911103:0:6768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755964.911104:0:6768:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784755964.911107:0:6768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1784755964.911162:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784755964.911185:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784755964.911195:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.911204:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755964.911213:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784755964.911215:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff96f185184d40 from 1 10000000:01000000:1.0:1784755964.911218:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784755964.911305:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.911313:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.911321:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755964.911333:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190026240:0@lo:101: 00000100:00100000:1.0:1784755964.911358:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755964.911371:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1bf9b0540 going to sleep for 11 seconds 00000100:00100000:1.0:1784755964.911382:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190026240 00000100:00100000:1.0:1784755964.911385:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190026240 00000100:00100000:1.0:1784755964.911418:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784755964.911425:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190026240:12345-0@lo:101: 00010000:00010000:1.0:1784755964.911433:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755964.911445:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84de6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84ddf expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.911475:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84ddf expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.911485:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84ddf expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.911493:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21dc800, rc 0) 00000100:00100000:1.0:1784755964.911521:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190026240:12345-0@lo:101: Request processed in 98us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755964.911527:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784755964.911556:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190026240:0@lo:101: 00010000:00010000:1.0:1784755964.911567:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.911576:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755964.911611:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190026368:0@lo:501: 00000100:00100000:1.0:1784755964.911632:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755964.911645:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1bf9b0540 going to sleep for 11 seconds 00000100:00100000:1.0:1784755964.911654:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190026368 00000100:00100000:1.0:1784755964.911657:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190026368 00000100:00100000:1.0:1784755964.911674:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784755964.911680:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190026368:12345-0@lo:501: 00000100:00100000:1.0:1784755964.911855:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190026368:12345-0@lo:501: Request processed in 174us (220us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784755964.911862:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784755964.912359:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1871452190025856:0@lo:400: 00000100:00100000:3.0:1784755964.912399:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755964.912446:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190025472:0@lo:400: 00000100:00100000:3.0:1784755964.912468:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755964.912528:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190026368:0@lo:501: 10000000:01000000:1.0:1784755964.912550:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784755964.912557:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755964.912564:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755964.912678:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190025856 00000100:00100000:0.0:1784755964.912682:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190025856 00000100:00100000:0.0:1784755964.912729:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190025472 00000100:00100000:0.0:1784755964.912732:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190025472 00000100:00100000:0.0:1784755964.912751:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755964.912758:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1871452190025856:12345-0@lo:400: 00000100:00100000:0.0:1784755964.912794:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1871452190025856:12345-0@lo:400: Request processed in 37us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.912810:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755964.912825:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784755964.912862:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190025472:12345-0@lo:400: 00000100:00100000:0.0:1784755964.912903:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190025472:12345-0@lo:400: Request processed in 72us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.912981:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784755964.913082:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1bbd15880 x1871452190025856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755964.913094:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1871452190025856:0@lo:400: 00010000:00080000:3.0:1784755964.913104:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1bbd17b80 x1871452190025472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755964.913112:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190025472:0@lo:400: 00000100:00080000:1.0:1784755964.913183:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1784755964.944591:0:5804:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1784755964.967745:0:6767:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1784755964.967761:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190026496:0@lo:13: 00000100:00100000:0.0:1784755964.967780:0:6767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1871452190026624:0@lo:7: 00000100:00100000:2.0:1784755964.967871:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755964.967913:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190026496 00000100:00100000:1.0:1784755964.967922:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190026496 00000100:00100000:1.0:1784755964.967983:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784755964.967995:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1871452190026496:12345-0@lo:13: 00002000:00000024:1.0:1784755964.968090:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1784755964.968151:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1871452190026496:12345-0@lo:13: Request processed in 158us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755964.968158:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1784755964.968182:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784755964.968389:0:6767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755964.968425:0:6767:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f188a409c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755964.968446:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190026624 00000100:00100000:1.0:1784755964.968452:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190026624 00000100:00100000:1.0:1784755964.968485:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784755964.968493:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6767:x1871452190026624:12345-0@lo:7: 00010000:00080000:2.0:1784755964.969191:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1ae2dd880 x1871452190026496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755964.969213:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190026496:0@lo:13: 00002000:00080000:0.0:1784755964.974950:0:6582:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1784755964.974960:0:6582:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1784755964.975068:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6767:x1871452190026624:12345-0@lo:7: Request processed in 6571us (6674us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755964.975080:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784755964.975185:0:6767:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1ae2dc000 x1871452190026624/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784755980 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755964.975198:0:6767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1871452190026624:0@lo:7: 00000004:00080000:2.0:1784755964.975210:0:6767:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1784755964.975256:0:6767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd14e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1871452190026752:0@lo:5: 00000100:00100000:2.0:1784755964.975293:0:6767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755964.975350:0:6767:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186922180 going to sleep for 11 seconds 00000100:00100000:3.0:1784755964.975469:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190026752 00000100:00100000:3.0:1784755964.975477:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190026752 00000100:00100000:3.0:1784755964.975522:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784755964.975531:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6767:x1871452190026752:12345-0@lo:5: 00002000:00080000:3.0:1784755964.975557:0:6581:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784755964.975561:0:6581:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1784755964.976183:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6767:x1871452190026752:12345-0@lo:5: Request processed in 653us (889us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784755964.976191:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784755964.976247:0:6767:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1bbd14e00 x1871452190026752/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784755980 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755964.976262:0:6767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd14e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1871452190026752:0@lo:5: 00000004:00080000:0.0:1784755964.976273:0:6767:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784755964.976300:0:6767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1871452190026880:0@lo:700: 00000100:00100000:0.0:1784755964.976328:0:6767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755964.976394:0:6767:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f188a40cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755964.976449:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190026880 00000100:00100000:3.0:1784755964.976454:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190026880 00000100:00100000:3.0:1784755964.976526:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784755964.976536:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6767:x1871452190026880:12345-0@lo:700: 00000100:00100000:3.0:1784755964.976583:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6588:1871452190027008:0@lo:700: 00000100:00100000:3.0:1784755964.976617:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755964.976659:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1838bc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755964.976731:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190027008 00000100:00100000:1.0:1784755964.976736:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190027008 00000100:00100000:1.0:1784755964.976820:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784755964.976828:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6588:x1871452190027008:12345-0@lo:700: 40000000:02000000:1.0:1784755965.005309:0:5788:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1784755965.012689:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6588:x1871452190027008:12345-0@lo:700: Request processed in 35855us (36063us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755965.012708:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784755965.013457:0:6588:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1851c8e00 x1871452190027008/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784755980 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755965.013471:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6588:1871452190027008:0@lo:700: 40000000:02000000:2.0:1784755965.013484:0:6588:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:0.0:1784755965.087894:0:6606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784755965.087913:0:6606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1784755965.088116:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6767:x1871452190026880:12345-0@lo:700: Request processed in 111577us (111782us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755965.088133:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784755965.088252:0:6767:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1ae2dd180 x1871452190026880/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784755980 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755965.088268:0:6767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1871452190026880:0@lo:700: 00000004:02000040:0.0:1784755965.123800:0:6767:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1784755965.126945:0:6767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1871452190027136:0@lo:5: 00000100:00100000:0.0:1784755965.127013:0:6767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755965.127069:0:6767:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f188a40f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784755965.128129:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190027136 00000100:00100000:3.0:1784755965.128139:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190027136 00000100:00100000:3.0:1784755965.128197:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784755965.128208:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6767:x1871452190027136:12345-0@lo:5: 00002000:00080000:3.0:1784755965.134447:0:6582:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1784755965.134467:0:6582:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1784755965.138175:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6767:x1871452190027136:12345-0@lo:5: Request processed in 9962us (11156us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784755965.138192:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784755965.138326:0:6767:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1ae2dd180 x1871452190027136/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784755981 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755965.138340:0:6767:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1784755965.138353:0:6767:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff96f1ae2dd180 x1871452190027136/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784755981 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755965.138363:0:6767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1871452190027136:0@lo:5: 00000004:00080000:0.0:1784755965.138376:0:6767:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1784755965.210000:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755966.232983:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755967.257742:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784755967.270701:0:6950:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784755968.281824:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755969.305049:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755970.328932:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755970.329989:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190027264:0@lo:400: 00000100:00100000:2.0:1784755970.330062:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755970.330108:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784755970.330113:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190027648:0@lo:400: 00000100:00100000:2.0:1784755970.330136:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755970.330162:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190027392:0@lo:400: 00000100:00100000:2.0:1784755970.330183:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755970.330199:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784755970.330204:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1871452190027520:0@lo:400: 00000100:00100000:2.0:1784755970.330221:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755970.330247:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190027264 00000100:00100000:2.0:1784755970.330253:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190027264 00000100:00100000:2.0:1784755970.330294:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784755970.330302:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+16:3303:x1871452190027264:12345-0@lo:400: 00000100:00100000:2.0:1784755970.332710:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+16:3303:x1871452190027264:12345-0@lo:400: Request processed in 2404us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755970.332720:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784755970.332771:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190027648 00000100:00100000:2.0:1784755970.332779:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190027648 00000100:00100000:2.0:1784755970.332829:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784755970.332851:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1871452190027648:12345-0@lo:400: 00000100:00100000:2.0:1784755970.333889:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1871452190027648:12345-0@lo:400: Request processed in 1038us (3749us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755970.333895:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784755970.333918:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190027392 00000100:00100000:2.0:1784755970.333922:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190027392 00000100:00100000:2.0:1784755970.333942:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190027520 00000100:00100000:2.0:1784755970.333944:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190027520 00000100:00100000:2.0:1784755970.334063:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755970.334072:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190027392:12345-0@lo:400: 00000100:00100000:2.0:1784755970.334105:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190027392:12345-0@lo:400: Request processed in 36us (3921us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755970.334109:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755970.334124:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784755970.334129:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1871452190027520:12345-0@lo:400: 00000100:00100000:2.0:1784755970.334205:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1871452190027520:12345-0@lo:400: Request processed in 76us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755970.334209:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1784755970.334228:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784755970.334231:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784755970.334240:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784755970.334251:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190027776:0@lo:13: 00000100:00100000:2.0:1784755970.334288:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755970.334357:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190027776 00000100:00100000:2.0:1784755970.334360:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190027776 00000100:00100000:2.0:1784755970.334380:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784755970.334384:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1871452190027776:12345-0@lo:13: 00002000:00000024:2.0:1784755970.334407:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755970.334431:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1871452190027776:12345-0@lo:13: Request processed in 47us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755970.334435:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784755970.334459:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1ae2dd500 x1871452190027776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755970.334472:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190027776:0@lo:13: 00010000:00080000:2.0:1784755970.334505:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1bbd16300 x1871452190027520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755970.334518:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1871452190027520:0@lo:400: 00010000:00080000:2.0:1784755970.334527:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1bbd17800 x1871452190027392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755970.334532:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190027392:0@lo:400: 00010000:00080000:2.0:1784755970.334572:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1bbd14e00 x1871452190027648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755970.334578:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190027648:0@lo:400: 00000100:00100000:2.0:1784755970.334585:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190027264:0@lo:400: 00000001:00080000:0.0:1784755970.380627:0:6606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1784755971.355349:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755972.377116:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755973.401029:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755974.425086:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755975.450215:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755975.453703:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190027904:0@lo:13: 00000100:00100000:2.0:1784755975.453769:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1871452190028160:0@lo:400: 00000100:00100000:0.0:1784755975.453778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755975.453810:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755975.453869:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784755975.453877:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190028032:0@lo:400: 00000100:00100000:0.0:1784755975.453915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755975.453918:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784755975.453928:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190028288:0@lo:400: 00000100:00100000:0.0:1784755975.453961:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190027904 00000100:00100000:0.0:1784755975.453968:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190027904 00000100:00100000:2.0:1784755975.454028:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755975.454031:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755975.454043:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190027904:12345-0@lo:13: 00000100:00100000:2.0:1784755975.454062:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190028160 00000100:00100000:2.0:1784755975.454067:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190028160 00002000:00000024:0.0:1784755975.454079:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755975.454133:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190027904:12345-0@lo:13: Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755975.454139:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784755975.454161:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190028032 00000100:00100000:0.0:1784755975.454164:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190028032 00000100:00100000:0.0:1784755975.454184:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784755975.454189:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:3300:x1871452190028032:12345-0@lo:400: 00000100:00100000:2.0:1784755975.454222:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190028288 00000100:00100000:2.0:1784755975.454227:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190028288 00000100:00100000:0.0:1784755975.454232:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:3300:x1871452190028032:12345-0@lo:400: Request processed in 42us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755975.454241:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784755975.454258:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784755975.454267:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1871452190028160:12345-0@lo:400: 00000100:00080000:0.0:1784755975.454274:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784755975.454279:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784755975.455511:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1871452190028160:12345-0@lo:400: Request processed in 1239us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755975.455524:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784755975.455548:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784755975.455555:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190028032:0@lo:400: 00000100:00100000:2.0:1784755975.455561:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190028288:12345-0@lo:400: 00000100:00100000:2.0:1784755975.455629:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190028288:12345-0@lo:400: Request processed in 73us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755975.455636:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784755975.455690:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1851ca300 x1871452190028288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755975.455709:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190028288:0@lo:400: 00010000:00080000:2.0:1784755975.455722:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1851cb800 x1871452190028160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755975.455729:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1871452190028160:0@lo:400: 00010000:00080000:1.0:1784755975.456253:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1ae2dc380 x1871452190027904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755975.456263:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784755975.456283:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190027904:0@lo:13: 00000020:01000004:0.0:1784755975.941483:0:7478:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784755975.941488:0:7478:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1784755975.941762:0:7478:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96f1abd8c000 00000020:01000004:0.0:1784755975.941779:0:7478:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1784755975.941793:0:7478:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1784755975.941816:0:7478:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96f1bc503380) 00000020:00000080:0.0:1784755975.941970:0:7478:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784755975.955800:0:7478:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1784755975.956076:0:7478:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1784755975.978410:0:7478:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784755975.983403:0:7478:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784755975.983443:0:7478:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784755975.983505:0:7478:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784755975.983534:0:7478:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784755975.983995:0:7478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1784755975.984006:0:7478:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784755975.984088:0:7478:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbe94f39231c84df4 00000020:01000004:3.0:1784755975.984105:0:7478:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1784755975.984126:0:7478:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.121@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784755975.984130:0:7478:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784755975.984139:0:7478:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1784755975.984159:0:7478:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1784755975.984164:0:7478:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784755976.006374:0:7478:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784755976.006410:0:7478:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.121@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1784755976.006414:0:7478:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784755976.006416:0:7478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784755976.006417:0:7478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784755976.006418:0:7478:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784755976.006419:0:7478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784755976.006420:0:7478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784755976.006422:0:7478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784755976.006423:0:7478:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784755976.006425:0:7478:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784755976.006426:0:7478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784755976.006428:0:7478:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784755976.006431:0:7478:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1784755976.006433:0:7478:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784755976.006434:0:7478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784755976.006436:0:7478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784755976.006437:0:7478:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784755976.006437:0:7478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784755976.006439:0:7478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784755976.006440:0:7478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784755976.006441:0:7478:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784755976.006442:0:7478:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784755976.006443:0:7478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784755976.006444:0:7478:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784755976.006470:0:7478:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784755976.006490:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190028416:0@lo:253: 00000100:00100000:3.0:1784755976.006560:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.006617:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d55300 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.006870:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190028416 00000100:00100000:2.0:1784755976.006879:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190028416 00000100:00100000:2.0:1784755976.006937:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784755976.006947:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:7478:x1871452190028416:12345-0@lo:253: 20000000:01000000:2.0:1784755976.006979:0:5776:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1784755976.006983:0:5776:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1784755976.006988:0:5776:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1784755976.006991:0:5776:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1784755976.009241:0:5776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784755976.012617:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1784755976.012650:0:5776:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1784755976.012923:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1784755976.012937:0:5776:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1784755976.012975:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1784755976.013059:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1784755976.013872:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1784755976.013896:0:5776:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.121@tcp 20000000:01000000:2.0:1784755976.013899:0:5776:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.121@tcp (null) (null) (null) 00000040:00080000:2.0:1784755976.013937:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1784755976.013952:0:5776:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784755976.014015:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1784755976.014091:0:5776:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.121@tcp (null) (null) 00000040:00080000:2.0:1784755976.014130:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1784755976.014141:0:5776:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1784755976.014176:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1784755976.014242:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1784755976.015615:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1784755976.015640:0:5776:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.121@tcp 20000000:01000000:2.0:1784755976.015642:0:5776:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.121@tcp (null) (null) (null) 00000040:00080000:2.0:1784755976.015674:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1784755976.015681:0:5776:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784755976.015708:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1784755976.015715:0:5776:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.121@tcp (null) (null) 00000040:00080000:2.0:1784755976.015740:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1784755976.015747:0:5776:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1784755976.015788:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1784755976.015824:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1784755976.015863:0:5776:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784755976.015866:0:5776:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784755976.015869:0:5776:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784755976.015880:0:5776:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784755976.015883:0:5776:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784755976.015915:0:5776:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1784755976.015918:0:5776:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784755976.017082:0:7481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1784755976.017438:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1784755976.017481:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1784755976.017550:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1784755976.017564:0:5776:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784755976.017567:0:5776:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784755976.019803:0:7482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1784755976.019906:0:7482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1784755976.019977:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1784755976.020300:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1784755976.020342:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1784755976.020516:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1784755976.020532:0:5776:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784755976.020534:0:5776:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784755976.022731:0:7483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1784755976.023277:0:7483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1784755976.023346:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1784755976.024459:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1784755976.024531:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1784755976.024571:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1784755976.024584:0:5776:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1784755976.024587:0:5776:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784755976.026182:0:7484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1784755976.026292:0:7484:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1784755976.026330:0:7484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1784755976.026747:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1784755976.026966:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1784755976.027109:0:5776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1784755976.027207:0:5776:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1784755976.027210:0:5776:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1784755976.027221:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784755976.027240:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027260:0:5776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d37 expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027274:0:5776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d61 expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027282:0:5776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f1c21dd800/0xbe94f39231c84d92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d8b expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027289:0:5776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f180031400/0xbe94f39231c84dae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84da7 expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027296:0:5776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84ddf expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027304:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027344:0:5776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84ddf expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027433:0:5776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84de6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84ddf expref: 16 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755976.027446:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1871452190028544:0@lo:104: 00000100:00100000:0.0:1784755976.027512:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784755976.027605:0:5776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f180031400/0xbe94f39231c84dae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84da7 expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027619:0:5776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f180031400/0xbe94f39231c84dae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84da7 expref: 16 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755976.027628:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1871452190028672:0@lo:104: 00010000:00010000:0.0:1784755976.027664:0:5776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f1c21dd800/0xbe94f39231c84d92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84d8b expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027671:0:5776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f1c21dd800/0xbe94f39231c84d92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84d8b expref: 16 pid: 5776 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755976.027679:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2df800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1871452190028800:0@lo:104: 00010000:00010000:0.0:1784755976.027700:0:5776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84d61 expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027707:0:5776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84d68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84d61 expref: 16 pid: 5777 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755976.027714:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1871452190028928:0@lo:104: 00010000:00010000:0.0:1784755976.027730:0:5776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84d37 expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.027737:0:5776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84d37 expref: 16 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755976.027744:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1871452190029056:0@lo:104: 00000100:00100000:0.0:1784755976.027757:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1878b8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.027978:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784755976.027997:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755976.028018:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755976.028102:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755976.028111:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755976.028188:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190028544 00000100:00100000:2.0:1784755976.028205:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190028544 00000100:00100000:2.0:1784755976.028239:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190028672 00000100:00100000:2.0:1784755976.028241:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190028672 00000100:00100000:2.0:1784755976.028249:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190028800 00000100:00100000:2.0:1784755976.028251:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190028800 00000100:00100000:2.0:1784755976.028258:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190028928 00000100:00100000:2.0:1784755976.028259:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190028928 00000100:00100000:2.0:1784755976.028266:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190029056 00000100:00100000:2.0:1784755976.028268:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190029056 00000100:00100000:2.0:1784755976.028278:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784755976.028285:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1a648c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+7:5776:x1871452190028544:12345-0@lo:104: 00010000:00010000:2.0:1784755976.028296:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.028405:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784755976.028412:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1a648c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+7:5776:x1871452190028544:12345-0@lo:104: Request processed in 128us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.028420:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784755976.028454:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784755976.028467:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+6:5776:x1871452190028672:12345-0@lo:104: 00010000:00010000:2.0:1784755976.028474:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.028516:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784755976.028521:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+6:5776:x1871452190028672:12345-0@lo:104: Request processed in 56us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.028526:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784755976.028537:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784755976.028542:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+5:5776:x1871452190028800:12345-0@lo:104: 00010000:00010000:2.0:1784755976.028548:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.028570:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784755976.028574:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+5:5776:x1871452190028800:12345-0@lo:104: Request processed in 33us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.028579:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784755976.028587:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784755976.028591:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+4:5776:x1871452190028928:12345-0@lo:104: 00010000:00010000:2.0:1784755976.028597:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.028617:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1784755976.028621:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+4:5776:x1871452190028928:12345-0@lo:104: Request processed in 30us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.028626:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784755976.028634:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784755976.028639:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:5776:x1871452190029056:12345-0@lo:104: 00010000:00010000:2.0:1784755976.028653:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.028678:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1784755976.028682:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:5776:x1871452190029056:12345-0@lo:104: Request processed in 44us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.028688:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1784755976.028801:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784755976.028814:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.028821:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21dc200 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:3.0:1784755976.028824:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.028870:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784755976.028878:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755976.028884:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784755976.028918:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.028925:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784755976.028942:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.028949:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84ddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84de6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.028962:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784755976.028966:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.028971:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181500a00 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:3.0:1784755976.028974:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.028991:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784755976.028997:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755976.029002:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784755976.029015:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029021:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784755976.029038:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029046:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84da7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84dae expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029055:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784755976.029058:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029064:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181501200 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:3.0:1784755976.029066:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029072:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784755976.029078:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755976.029090:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784755976.029104:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029110:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784755976.029137:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029144:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84d8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d92 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029156:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784755976.029159:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029164:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f180031000 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:3.0:1784755976.029166:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029172:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784755976.029177:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755976.029183:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784755976.029193:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029209:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784755976.029221:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029227:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84d61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d68 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029236:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784755976.029239:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029244:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181501000 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:3.0:1784755976.029246:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029252:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784755976.029258:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755976.029262:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784755976.029272:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029277:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784755976.029280:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84d37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029284:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d3e expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029295:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755976.029301:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755976.029302:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784755976.029317:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190029440:0@lo:103: 00000100:00100000:3.0:1784755976.029541:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.029581:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784755976.029587:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190029568:0@lo:103: 00000100:00100000:3.0:1784755976.029609:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.029646:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190029440 00000100:00100000:3.0:1784755976.029651:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190029440 00010000:00010000:3.0:1784755976.029674:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f1c21dd800/0xbe94f39231c84d92 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84d8b expref: 17 pid: 5776 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755976.029698:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190029568 00000100:00100000:3.0:1784755976.029701:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190029568 00010000:00010000:3.0:1784755976.029710:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84d68 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84d61 expref: 18 pid: 5777 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755976.029721:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784755976.029725:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+18:3302:x1871452190029440:12345-0@lo:103: 00010000:00010000:3.0:1784755976.029736:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784755976.029740:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f1c21dd800/0xbe94f39231c84d92 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84d8b expref: 18 pid: 5776 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029748:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f1c21dd800/0xbe94f39231c84d92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84d8b expref: 18 pid: 5776 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029762:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784755976.029789:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+18:3302:x1871452190029440:12345-0@lo:103: Request processed in 63us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755976.029796:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784755976.029818:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784755976.029824:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+17:3302:x1871452190029568:12345-0@lo:103: 00010000:00010000:3.0:1784755976.029853:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784755976.029858:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84d68 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84d61 expref: 17 pid: 5777 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029866:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84d68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84d61 expref: 17 pid: 5777 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.029876:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784755976.029898:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+17:3302:x1871452190029568:12345-0@lo:103: Request processed in 75us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755976.029905:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1784755976.029943:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784755976.029947:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190029568:0@lo:103: 00000100:00100000:3.0:1784755976.029962:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190029440:0@lo:103: 00000100:00100000:1.0:1784755976.029962:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190029184:0@lo:103: 00000100:00100000:1.0:1784755976.030004:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755976.030033:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190029696:0@lo:103: 00000100:00100000:1.0:1784755976.030053:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755976.030074:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784755976.030080:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190029312:0@lo:103: 00000100:00100000:3.0:1784755976.030099:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190029184 00000100:00100000:3.0:1784755976.030104:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190029184 00000100:00100000:1.0:1784755976.030105:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755976.030148:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190029696 00000100:00100000:1.0:1784755976.030160:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190029696 00010000:00010000:1.0:1784755976.030178:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84d3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84d37 expref: 18 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.030184:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84de6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84ddf expref: 18 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755976.030213:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190029312 00000100:00100000:3.0:1784755976.030218:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784755976.030218:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190029312 00000100:00100000:3.0:1784755976.030228:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190029696:12345-0@lo:103: 00010000:00010000:3.0:1784755976.030237:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784755976.030237:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f180031400/0xbe94f39231c84dae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84da7 expref: 19 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.030245:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84d3e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84d37 expref: 19 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.030256:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84d37 expref: 19 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755976.030259:0:5769:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784755976.030266:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1784755976.030280:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784755976.030286:0:5768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784755976.030300:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784755976.030308:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190029184:12345-0@lo:103: 00000100:00100000:3.0:1784755976.030317:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190029696:12345-0@lo:103: Request processed in 89us (260us total) trans 0 rc 0/0 00010000:00010000:1.0:1784755976.030317:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784755976.030327:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1784755976.030327:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84de6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84ddf expref: 19 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030341:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84de6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84ddf expref: 18 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030351:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784755976.030377:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+18:3300:x1871452190029184:12345-0@lo:103: Request processed in 71us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.030384:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784755976.030398:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784755976.030404:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+17:3300:x1871452190029312:12345-0@lo:103: 00010000:00010000:1.0:1784755976.030411:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784755976.030415:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f180031400/0xbe94f39231c84dae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84da7 expref: 17 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030435:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f180031400/0xbe94f39231c84dae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84da7 expref: 17 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030449:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030458:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030471:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030478:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755976.030481:0:5767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1784755976.030486:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030495:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030502:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f180031a00 already unused, calling callback (ffffffffc1436230) 00010000:00010000:1.0:1784755976.030506:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030514:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030522:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.030543:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784755976.030566:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84de6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84ddf expref: 17 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755976.030583:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+16:3300:x1871452190029312:12345-0@lo:103: Request processed in 176us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755976.030583:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1871452190028544:0@lo:104: 00000100:00100000:1.0:1784755976.030597:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1784755976.030622:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f180031400/0xbe94f39231c84dae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84da7 expref: 15 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755976.030632:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190029312:0@lo:103: 00000100:00100000:1.0:1784755976.030649:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190029184:0@lo:103: 00000100:00100000:0.0:1784755976.030650:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1871452190028672:0@lo:104: 00000100:00100000:1.0:1784755976.030667:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190029696:0@lo:103: 00010000:00010000:0.0:1784755976.030674:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f1c21dd800/0xbe94f39231c84d92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84d8b expref: 14 pid: 5776 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755976.030685:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2df800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1871452190028800:0@lo:104: 00010000:00010000:0.0:1784755976.030695:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84d68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84d61 expref: 13 pid: 5777 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755976.030703:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1871452190028928:0@lo:104: 00010000:00010000:0.0:1784755976.030711:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84d3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84d37 expref: 12 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755976.030723:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5776:1871452190029056:0@lo:104: 00010000:00010000:0.0:1784755976.030747:0:5776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.030755:0:5776:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.030761:0:5776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.030767:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f180031a00/0xbe94f39231c84dfb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784755976.030780:0:5776:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784755976.073866:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+11:7478:x1871452190028416:12345-0@lo:253: Request processed in 66885us (67270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.073880:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784755976.073983:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190028416:0@lo:253: 10000000:01000000:3.0:1784755976.073998:0:7478:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784755976.074001:0:7478:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784755976.074003:0:7478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784755976.074004:0:7478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784755976.074006:0:7478:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1784755976.074007:0:7478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784755976.074020:0:7478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784755976.074021:0:7478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784755976.074023:0:7478:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784755976.074024:0:7478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784755976.074025:0:7478:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784755976.074045:0:7478:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96f1abd8c000 from lustre-OST0001 10000000:01000000:3.0:1784755976.074069:0:7478:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784755976.074072:0:7478:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784755976.074089:0:7478:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff96f185184d40 local copy 10000000:01000000:3.0:1784755976.074093:0:7478:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784755976.074130:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.074142:0:7478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.074151:0:7478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755976.074169:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190029824:0@lo:101: 00000100:00100000:3.0:1784755976.074227:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.074285:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d550c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755976.074374:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190029824 00000100:00100000:0.0:1784755976.074381:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190029824 00000100:00100000:0.0:1784755976.074434:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784755976.074443:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+11:7478:x1871452190029824:12345-0@lo:101: 00010000:00010000:0.0:1784755976.074455:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755976.074469:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84e02 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.074490:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84e02 expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.074500:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e02 expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.074509:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f180031a00, rc 0) 00000100:00100000:0.0:1784755976.074555:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190029824:12345-0@lo:101: Request processed in 113us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755976.074561:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784755976.075046:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190029824:0@lo:101: 00010000:00010000:3.0:1784755976.075064:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.075073:0:7478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755976.075182:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190029952:0@lo:501: 00000100:00100000:3.0:1784755976.075229:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.075334:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d550c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755976.075420:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190029952 00000100:00100000:1.0:1784755976.075425:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190029952 00000100:00100000:1.0:1784755976.075500:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784755976.075507:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190029952:12345-0@lo:501: 00000100:00100000:1.0:1784755976.075718:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190029952:12345-0@lo:501: Request processed in 211us (488us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784755976.075725:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784755976.075789:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190029952:0@lo:501: 10000000:01000000:3.0:1784755976.075805:0:7478:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784755976.075848:0:7478:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784755976.075854:0:7478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.075862:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.075868:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.075893:0:7478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784755976.075911:0:7478:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96f1abd8c000 10000000:01000000:3.0:1784755976.075916:0:7478:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784755976.075921:0:7478:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784755976.075929:0:7478:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784755976.075933:0:7478:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784755976.075936:0:7478:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784755976.075954:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.075961:0:7478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.075968:0:7478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755976.075981:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030080:0@lo:101: 00000100:00100000:3.0:1784755976.076017:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784755976.076129:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784755976.076136:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.076144:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181501000 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:0.0:1784755976.076148:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.076156:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755976.076163:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755976.076180:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784755976.076212:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.076218:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755976.076237:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.076245:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f181501000/0xbe94f39231c84e02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbe94f39231c84e09 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.076262:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755976.076263:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755976.076265:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755976.076277:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190030208:0@lo:103: 00000100:00100000:0.0:1784755976.076306:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755976.076346:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190030208 00000100:00100000:0.0:1784755976.076351:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190030208 00000100:00100000:0.0:1784755976.076380:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784755976.076386:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+12:3301:x1871452190030208:12345-0@lo:103: 00010000:00010000:0.0:1784755976.076395:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755976.076408:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbe94f39231c84e02 expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.076423:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755976.076447:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+11:3301:x1871452190030208:12345-0@lo:103: Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755976.076454:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784755976.076491:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190030208:0@lo:103: 00000100:00100000:3.0:1784755976.076615:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d55a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.076699:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190030080 00000100:00100000:2.0:1784755976.076704:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190030080 00000100:00100000:2.0:1784755976.076727:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784755976.076734:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+11:7478:x1871452190030080:12345-0@lo:101: 00010000:00010000:2.0:1784755976.076742:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755976.076754:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84e17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84e10 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.076770:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84e10 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.076779:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e10 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.076785:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21df600, rc 0) 00000100:00100000:2.0:1784755976.076896:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190030080:12345-0@lo:101: Request processed in 162us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.076901:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784755976.077158:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030080:0@lo:101: 00010000:00010000:3.0:1784755976.077175:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.077184:0:7478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755976.077272:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030336:0@lo:501: 00000100:00100000:3.0:1784755976.077298:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.077526:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d55a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.077562:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190030336 00000100:00100000:2.0:1784755976.077566:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190030336 00000100:00100000:2.0:1784755976.077687:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784755976.077695:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190030336:12345-0@lo:501: 00000100:00100000:2.0:1784755976.077952:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190030336:12345-0@lo:501: Request processed in 258us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.077964:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784755976.078107:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030336:0@lo:501: 00000100:00100000:3.0:1784755976.078143:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030464:0@lo:503: 00000100:00100000:3.0:1784755976.078182:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.078224:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d55a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784755976.078290:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190030464 00000100:00100000:0.0:1784755976.078295:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190030464 00000100:00100000:0.0:1784755976.078329:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784755976.078335:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190030464:12345-0@lo:503: 00000100:00100000:0.0:1784755976.078507:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190030464:12345-0@lo:503: Request processed in 172us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755976.078512:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784755976.078560:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030464:0@lo:503: 00000040:00080000:3.0:1784755976.078773:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784755976.078814:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030592:0@lo:502: 00000100:00100000:3.0:1784755976.078936:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755976.078982:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190030592 00000100:00100000:3.0:1784755976.078984:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d55a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.078986:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190030592 00000100:00100000:2.0:1784755976.079114:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784755976.079122:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190030592:12345-0@lo:502: 00000100:00100000:2.0:1784755976.079278:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190030592:12345-0@lo:502: Request processed in 157us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.079284:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784755976.079310:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030592:0@lo:502: 00000040:00080000:3.0:1784755976.079508:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784755976.079542:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784755976.079559:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784755976.079584:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784755976.079603:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784755976.079620:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784755976.079636:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030720:0@lo:502: 00000100:00100000:3.0:1784755976.079663:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.079684:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d55a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784755976.079700:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190030720 00000100:00100000:0.0:1784755976.079704:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190030720 00000100:00100000:0.0:1784755976.079736:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784755976.079743:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190030720:12345-0@lo:502: 00000100:00100000:0.0:1784755976.079893:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190030720:12345-0@lo:502: Request processed in 150us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755976.079900:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784755976.079949:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030720:0@lo:502: 00000040:00080000:3.0:1784755976.080103:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784755976.080115:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1784755976.080598:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784755976.080607:0:7488:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1784755976.080613:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755976.080615:0:7488:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784755976.080620:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784755976.080642:0:7488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff96f1bc47b380) 00000020:00000080:3.0:1784755976.080663:0:7488:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784755976.080670:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784755976.080864:0:7488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96f1abd8c000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784755976.080873:0:7488:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784755976.080885:0:7488:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbe94f39231c84e25 00010000:00010000:2.0:1784755976.086823:0:7488:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1784755976.087353:0:7488:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1784755976.090240:0:7488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1784755976.090782:0:7488:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1784755976.095826:0:7488:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1784755976.096622:0:7488:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1784755976.098882:0:7488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1784755976.098894:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784755976.098900:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755976.098902:0:7488:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1784755976.098905:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784755976.098908:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755976.098910:0:7488:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784755976.098912:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784755976.098914:0:7488:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784755976.098967:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784755976.098970:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755976.098971:0:7488:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784755976.098975:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1784755976.099242:0:7478:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1784755976.099264:0:7478:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784755976.099289:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.099302:0:7478:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755976.099309:0:7478:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96f1abd8c000 from 1 10000000:01000000:3.0:1784755976.099312:0:7478:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784755976.099346:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.099353:0:7478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.099363:0:7478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755976.099387:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030848:0@lo:101: 00000100:00100000:3.0:1784755976.099473:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.099666:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.099811:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190030848 00000100:00100000:2.0:1784755976.099829:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190030848 00000100:00100000:2.0:1784755976.100166:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784755976.100178:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:7478:x1871452190030848:12345-0@lo:101: 00010000:00010000:2.0:1784755976.100192:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755976.100285:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84e33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84e2c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.100311:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84e2c expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.100323:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e2c expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.100331:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21de000, rc 0) 00000100:00100000:2.0:1784755976.100400:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+13:7478:x1871452190030848:12345-0@lo:101: Request processed in 216us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.100407:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784755976.100492:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030848:0@lo:101: 00010000:00010000:3.0:1784755976.100524:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.100543:0:7478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755976.100663:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030976:0@lo:501: 00000100:00100000:3.0:1784755976.100692:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.100719:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.100727:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190030976 00000100:00100000:2.0:1784755976.100732:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190030976 00000100:00100000:2.0:1784755976.100764:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784755976.100771:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:7478:x1871452190030976:12345-0@lo:501: 00000100:00100000:2.0:1784755976.101093:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:7478:x1871452190030976:12345-0@lo:501: Request processed in 322us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.101100:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784755976.101108:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190030976:0@lo:501: 00000100:00100000:3.0:1784755976.101136:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031104:0@lo:503: 00000100:00100000:3.0:1784755976.101168:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.101189:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.101210:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190031104 00000100:00100000:2.0:1784755976.101214:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190031104 00000100:00100000:2.0:1784755976.101339:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784755976.101347:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+13:7478:x1871452190031104:12345-0@lo:503: 00000100:00100000:2.0:1784755976.101928:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+13:7478:x1871452190031104:12345-0@lo:503: Request processed in 581us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.101940:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784755976.102096:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031104:0@lo:503: 00000040:00080000:3.0:1784755976.102613:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784755976.102691:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031232:0@lo:502: 00000100:00100000:3.0:1784755976.102731:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.102765:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.102817:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190031232 00000100:00100000:2.0:1784755976.102823:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190031232 00000100:00100000:2.0:1784755976.103700:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784755976.103711:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:7478:x1871452190031232:12345-0@lo:502: 00000100:00100000:2.0:1784755976.104503:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:7478:x1871452190031232:12345-0@lo:502: Request processed in 793us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.104512:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784755976.104898:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031232:0@lo:502: 00000040:00080000:3.0:1784755976.105942:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1784755976.106069:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1784755976.106111:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031360:0@lo:502: 00000100:00100000:3.0:1784755976.106165:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.106264:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.106497:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190031360 00000100:00100000:2.0:1784755976.106504:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190031360 00000100:00100000:2.0:1784755976.106552:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784755976.106561:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+13:7478:x1871452190031360:12345-0@lo:502: 00000100:00100000:2.0:1784755976.106871:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+13:7478:x1871452190031360:12345-0@lo:502: Request processed in 311us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.106879:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784755976.106960:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031360:0@lo:502: 00000040:00080000:3.0:1784755976.107121:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1784755976.107133:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784755976.107975:0:7492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784755976.107986:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755976.107988:0:7492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784755976.108001:0:7492:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96f1abd8c000 00000020:00000080:3.0:1784755976.108003:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784755976.108100:0:7492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755976.108103:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755976.108105:0:7492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784755976.108108:0:7492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784755976.108228:0:7478:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784755976.108247:0:7478:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784755976.108308:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.108320:0:7478:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755976.108390:0:7478:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784755976.108394:0:7478:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96f1abd8c000 10000000:01000000:1.0:1784755976.108397:0:7478:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96f1abd8c000 10000000:01000000:1.0:1784755976.108411:0:7478:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784755976.108417:0:7478:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96f1abd8c000 from 1 10000000:01000000:1.0:1784755976.108420:0:7478:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784755976.108464:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.108472:0:7478:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.108481:0:7478:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755976.108503:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031488:0@lo:101: 00000100:00100000:1.0:1784755976.108568:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755976.108613:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1869229c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755976.108673:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190031488 00000100:00100000:0.0:1784755976.108679:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190031488 00000100:00100000:0.0:1784755976.108752:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784755976.108761:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:7478:x1871452190031488:12345-0@lo:101: 00010000:00010000:0.0:1784755976.108774:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755976.108786:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84e3a expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.108809:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84e3a expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.108818:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e3a expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755976.108869:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f180031a00, rc 0) 00000100:00100000:0.0:1784755976.108910:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+14:7478:x1871452190031488:12345-0@lo:101: Request processed in 150us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755976.108916:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784755976.109016:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031488:0@lo:101: 00010000:00010000:3.0:1784755976.109032:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.109042:0:7478:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755976.109120:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031616:0@lo:501: 00000100:00100000:3.0:1784755976.109150:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.109520:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d55c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784755976.109591:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190031616 00000100:00100000:1.0:1784755976.109596:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190031616 00000100:00100000:1.0:1784755976.109620:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784755976.109626:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+14:7478:x1871452190031616:12345-0@lo:501: 00000100:00100000:1.0:1784755976.109933:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+14:7478:x1871452190031616:12345-0@lo:501: Request processed in 305us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.109940:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784755976.110096:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031616:0@lo:501: 00000100:00100000:3.0:1784755976.110132:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031744:0@lo:503: 00000100:00100000:3.0:1784755976.110170:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755976.110221:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190031744 00000100:00100000:2.0:1784755976.110226:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190031744 00000100:00100000:3.0:1784755976.110234:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d55c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.110424:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784755976.110432:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:7478:x1871452190031744:12345-0@lo:503: 00000100:00100000:2.0:1784755976.110675:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:7478:x1871452190031744:12345-0@lo:503: Request processed in 243us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.110682:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784755976.110760:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031744:0@lo:503: 00000040:00080000:3.0:1784755976.111540:0:7478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784755976.111604:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031872:0@lo:502: 00000100:00100000:3.0:1784755976.111652:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.111689:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d55c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784755976.111693:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190031872 00000100:00100000:1.0:1784755976.111699:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190031872 00000100:00100000:1.0:1784755976.111730:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784755976.111741:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+14:7478:x1871452190031872:12345-0@lo:502: 00000100:00100000:1.0:1784755976.112174:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+14:7478:x1871452190031872:12345-0@lo:502: Request processed in 431us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.112182:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784755976.112223:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190031872:0@lo:502: 00000040:00080000:3.0:1784755976.112707:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1784755976.112768:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1784755976.112806:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1784755976.112924:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1784755976.112953:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1784755976.112983:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1784755976.113077:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1784755976.113105:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1784755976.113136:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1784755976.113161:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1784755976.113209:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1784755976.113337:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1784755976.113463:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1784755976.113505:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1784755976.113574:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1784755976.113614:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1784755976.113653:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1784755976.113704:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1784755976.113744:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1784755976.113780:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1784755976.113948:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1784755976.113981:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1784755976.114000:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1784755976.114106:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1784755976.114130:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1784755976.114148:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1784755976.114173:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1784755976.114191:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1784755976.114239:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1784755976.114344:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1784755976.114478:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1784755976.114509:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1784755976.114528:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1784755976.114572:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1784755976.114619:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1784755976.114651:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1784755976.114681:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1784755976.114730:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190032000:0@lo:502: 00000100:00100000:3.0:1784755976.114797:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755976.114898:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190032000 00000100:00100000:3.0:1784755976.114905:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d55c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784755976.114906:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190032000 00000100:00100000:2.0:1784755976.114954:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784755976.114964:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:7478:x1871452190032000:12345-0@lo:502: 00000100:00100000:2.0:1784755976.115185:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:7478:x1871452190032000:12345-0@lo:502: Request processed in 220us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.115203:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784755976.115232:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190032000:0@lo:502: 00000040:00080000:3.0:1784755976.115460:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1784755976.115472:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1784755976.116102:0:7493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1784755976.116116:0:7493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff96f1bc47cd40) 00000020:00000080:3.0:1784755976.116138:0:7493:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1784755976.116314:0:7493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96f1abd8c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784755976.116319:0:7493:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96f1abd8c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784755976.116322:0:7493:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96f1abd8c000 3 00010000:00080000:3.0:1784755976.116360:0:7493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96f1bc59c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.121@tcp at head 00010000:00010000:3.0:1784755976.118008:0:7493:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1784755976.118104:0:7493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1784755976.118149:0:7493:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784755976.118162:0:7493:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbe94f39231c84e4f 00000100:00080000:3.0:1784755976.118171:0:7493:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784755976.118177:0:7493:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff96f1bc59c800 using connection 192.168.204.121@tcp/0@lo 00000100:00100000:3.0:1784755976.118221:0:7493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96f1851c9180 x1871452190032128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784755976.118240:0:7493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784755976.118350:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1871452190032128:0@lo:38: 00000100:00100000:2.0:1784755976.118388:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190032384:0@lo:400: 00000100:00100000:1.0:1784755976.118420:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755976.118468:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755976.118490:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190032512:0@lo:400: 00000100:00100000:2.0:1784755976.118503:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784755976.118513:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1871452190032256:0@lo:400: 00000100:00100000:1.0:1784755976.118526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755976.118568:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190032128 00000100:00100000:1.0:1784755976.118576:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190032128 00000100:00100000:2.0:1784755976.118626:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755976.118863:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190032384 00000100:00100000:1.0:1784755976.118868:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190032384 00000100:00100000:2.0:1784755976.118888:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190032256 00000100:00100000:2.0:1784755976.118893:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190032256 00000100:00100000:1.0:1784755976.118901:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784755976.118913:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190032384:12345-0@lo:400: 00000100:00100000:2.0:1784755976.118920:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784755976.118929:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1871452190032256:12345-0@lo:400: 00000100:00100000:1.0:1784755976.119103:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190032384:12345-0@lo:400: Request processed in 193us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.119111:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784755976.119127:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784755976.119132:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1871452190032128:12345-0@lo:38: 00010000:00080000:1.0:1784755976.119151:0:5781:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:1.0:1784755976.119180:0:5781:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbe94f39231c84e56 00000100:00100000:2.0:1784755976.119215:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1871452190032256:12345-0@lo:400: Request processed in 287us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.119224:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1784755976.119250:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1bbd16d80 x1871452190032256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755976.119265:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1871452190032256:0@lo:400: 00010000:00080000:3.0:1784755976.119288:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1bbd15500 x1871452190032384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755976.119296:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190032384:0@lo:400: 00000004:00100000:1.0:1784755976.119337:0:5781:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784755976.119367:0:5781:0:(import.c:65:import_set_state_nolock()) ffff96f1bf859800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784755976.119444:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1871452190032128:12345-0@lo:38: Request processed in 310us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.119451:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784755976.119477:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190032512 00000100:00100000:1.0:1784755976.119481:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190032512 00000100:00100000:1.0:1784755976.119514:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784755976.119521:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190032512:12345-0@lo:400: 00000100:00100000:1.0:1784755976.119557:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190032512:12345-0@lo:400: Request processed in 36us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.119564:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784755976.119592:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1bbd17100 x1871452190032512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755976.119603:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190032512:0@lo:400: 00000040:00080000:0.0:1784755976.119789:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1784755976.119864:0:7478:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1784755976.119893:0:7478:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784755976.119908:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.119919:0:7478:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784755976.119936:0:7494:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff96f1ae2dce00 x1871452190032640/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755976.119947:0:7494:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b53bccc0 going to sleep for 0 seconds 00000020:01000004:1.0:1784755976.119965:0:7478:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784755976.119967:0:7478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784755976.119969:0:7478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784755976.119970:0:7478:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784755976.119971:0:7478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784755976.119972:0:7478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784755976.119974:0:7478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784755976.119975:0:7478:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784755976.119977:0:7478:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784755976.119978:0:7478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784755976.119980:0:7478:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784755976.119983:0:7478:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1784755976.119986:0:7478:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784755976.119987:0:7478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784755976.119993:0:7478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784755976.119994:0:7478:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784755976.119995:0:7478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784755976.119996:0:7478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784755976.119997:0:7478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784755976.119998:0:7478:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784755976.119998:0:7478:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784755976.120000:0:7478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784755976.120001:0:7478:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784755976.120014:0:7478:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784755976.120022:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190032768:0@lo:253: 00000100:00100000:1.0:1784755976.120059:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755976.120087:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186922e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784755976.120107:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190032768 00000100:00100000:1.0:1784755976.120111:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190032768 00000100:00100000:1.0:1784755976.120139:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784755976.120146:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+14:7478:x1871452190032768:12345-0@lo:253: 20000000:01000000:1.0:1784755976.120168:0:5776:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784755976.120180:0:5776:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1784755976.120293:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1851c9180 x1871452190032128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784755986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755976.120303:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784755976.120309:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1784755976.120317:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784755976.120322:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784755976.120324:0:3299:0:(import.c:65:import_set_state_nolock()) ffff96f1bc59c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1784755976.120331:0:3299:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c1794f21): req@ffff96f1ae2dce00 x1871452190032640/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755976.120352:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1871452190032128:0@lo:38: 00000100:00100000:0.0:1784755976.120559:0:7494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755976.120583:0:7494:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b53bccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755976.120658:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190032640 00000100:00100000:3.0:1784755976.120661:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190032640 00000100:00080000:2.0:1784755976.120701:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784755976.120702:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784755976.120710:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7494:x1871452190032640:12345-0@lo:901: 00000100:00100000:3.0:1784755976.121075:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7494:x1871452190032640:12345-0@lo:901: Request processed in 303us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755976.121083:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784755976.121097:0:7494:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96f1ae2dce00 x1871452190032640/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784755992 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755976.121109:0:7494:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dce00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7494:1871452190032640:0@lo:901: 20000000:01000000:1.0:1784755976.134988:0:5776:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784755976.135012:0:5776:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1784755976.135021:0:5797:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784755976.135026:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784755976.135052:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.135071:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f180030e00/0xbe94f39231c84da0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d99 expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.135092:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.135131:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f180030e00/0xbe94f39231c84da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84d99 expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755976.135145:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f180030e00/0xbe94f39231c84da0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84d99 expref: 14 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755976.135160:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5797:1871452190032896:0@lo:104: 00000100:00100000:3.0:1784755976.135230:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755976.135274:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f198d55a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784755976.135303:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190032896 00000100:00100000:1.0:1784755976.135310:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190032896 00000100:00100000:1.0:1784755976.135365:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784755976.135374:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9117e42-6e26-4b4a-b619-3540b762413c+3:5797:x1871452190032896:12345-0@lo:104: 00010000:00010000:1.0:1784755976.135385:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135446:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784755976.135451:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f9117e42-6e26-4b4a-b619-3540b762413c+3:5797:x1871452190032896:12345-0@lo:104: Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755976.135461:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5797:1871452190032896:0@lo:104: 00000100:00100000:1.0:1784755976.135469:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1784755976.135488:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135495:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784755976.135500:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135508:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21de800 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:1.0:1784755976.135511:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135520:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784755976.135527:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755976.135532:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784755976.135557:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135564:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784755976.135583:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135590:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f1c21de800/0xbe94f39231c84d99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84da0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755976.135593:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190033024:0@lo:103: 00010000:00010000:1.0:1784755976.135607:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755976.135609:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755976.135611:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755976.135621:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755976.135685:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190033024 00000100:00100000:1.0:1784755976.135689:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190033024 00010000:00010000:1.0:1784755976.135706:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f180030e00/0xbe94f39231c84da0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84d99 expref: 15 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755976.135742:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784755976.135748:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f198c16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+15:3301:x1871452190033024:12345-0@lo:103: 00010000:00010000:1.0:1784755976.135758:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784755976.135763:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f180030e00/0xbe94f39231c84da0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84d99 expref: 15 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135772:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f180030e00/0xbe94f39231c84da0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84d99 expref: 15 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135784:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f180030e00/0xbe94f39231c84da0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84d99 expref: 15 pid: 5774 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135796:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135805:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784755976.135814:0:5769:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004718297s 00010000:00010000:1.0:1784755976.135816:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135821:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135825:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135829:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135864:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181501800 already unused, calling callback (ffffffffc1436230) 00010000:00010000:1.0:1784755976.135868:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135876:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135889:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755976.135898:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784755976.135901:0:5797:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.135913:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755976.135920:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f181501800/0xbe94f39231c84e5d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755976.135927:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f198c16050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+14:3301:x1871452190033024:12345-0@lo:103: Request processed in 179us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755976.135932:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784755976.135975:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190033024:0@lo:103: 00000100:00100000:3.0:1784755976.139871:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+13:7478:x1871452190032768:12345-0@lo:253: Request processed in 19717us (19804us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755976.139885:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784755976.139944:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f9117e42-6e26-4b4a-b619-3540b762413c:7478:1871452190032768:0@lo:253: 10000000:01000000:1.0:1784755976.139959:0:7478:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784755976.139963:0:7478:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784755976.139965:0:7478:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784755976.139966:0:7478:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784755976.139967:0:7478:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784755976.139969:0:7478:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784755976.139970:0:7478:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784755976.139972:0:7478:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784755976.139973:0:7478:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784755976.139974:0:7478:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784755976.139976:0:7478:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784755976.139978:0:7478:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784755976.139994:0:7478:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784755976.142980:0:7478:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1784755976.143139:0:7478:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784755976.143340:0:7478:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1784755976.143467:0:7478:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784755976.143627:0:7478:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1784755976.143811:0:7478:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784755976.145055:0:7478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1784755976.267862:0:7478:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1784755976.267870:0:7478:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1784755976.267907:0:7478:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784755976.267971:0:7478:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.121@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784755976.267986:0:7478:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1784755976.268160:0:7478:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1784755976.473225:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755977.497761:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755978.522264:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755979.548432:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755980.569980:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755980.570022:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190033152:0@lo:13: 00000100:00100000:1.0:1784755980.570084:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755980.570139:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190033152 00000100:00100000:2.0:1784755980.570146:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190033152 00000100:00100000:2.0:1784755980.570206:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755980.570214:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190033152:12345-0@lo:13: 00002000:00000024:2.0:1784755980.570246:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755980.570294:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190033152:12345-0@lo:13: Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755980.570301:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1784755980.570319:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784755980.570344:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53db100 x1871452190033152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755980.570360:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190033152:0@lo:13: 00000001:02000400:2.0:1784755981.532187:0:7835:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1784755981.595139:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190033280:0@lo:400: 00000100:00100000:2.0:1784755981.595208:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.595253:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1871452190033792:0@lo:400: 00000100:00100000:2.0:1784755981.595291:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.595323:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784755981.595329:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190033664:0@lo:400: 00000100:00100000:2.0:1784755981.595353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.595381:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1871452190033536:0@lo:400: 00000100:00100000:2.0:1784755981.595402:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.595423:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784755981.595439:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190033408:0@lo:400: 00000100:00100000:2.0:1784755981.595460:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.595670:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190033280 00000100:00100000:2.0:1784755981.595677:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190033280 00000100:00100000:2.0:1784755981.595716:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784755981.595724:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+13:3303:x1871452190033280:12345-0@lo:400: 00000100:00100000:2.0:1784755981.595771:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+13:3303:x1871452190033280:12345-0@lo:400: Request processed in 47us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755981.595778:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784755981.595807:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190033792 00000100:00100000:2.0:1784755981.595810:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190033792 10000000:01000000:1.0:1784755981.596018:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784755981.596023:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96f1bc39f800 from 30 10000000:01000000:1.0:1784755981.596027:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784755981.596055:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.596066:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.596077:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755981.596173:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190033536 00000100:00100000:2.0:1784755981.596177:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190033536 00000100:00100000:2.0:1784755981.596194:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190033408 00000100:00100000:2.0:1784755981.596196:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190033408 00000100:00100000:2.0:1784755981.596208:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784755981.596214:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1871452190033792:12345-0@lo:400: 00000100:00100000:2.0:1784755981.596248:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1871452190033792:12345-0@lo:400: Request processed in 34us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.596325:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190033920:0@lo:101: 00000100:00100000:1.0:1784755981.596356:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755981.596381:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18516b000 going to sleep for 11 seconds 00000100:00100000:1.0:1784755981.596402:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784755981.596547:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1871452190033536:12345-0@lo:400: 00000100:00100000:2.0:1784755981.596647:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784755981.596662:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784755981.596668:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190033408:12345-0@lo:400: 00000100:00100000:1.0:1784755981.596994:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1871452190033536:12345-0@lo:400: Request processed in 570us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.597001:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784755981.597020:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190033920 00000100:00100000:1.0:1784755981.597024:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190033920 00000100:00100000:1.0:1784755981.597049:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784755981.597057:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:5779:x1871452190033920:12345-0@lo:101: 00010000:00010000:1.0:1784755981.597066:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755981.597079:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21dc200/0xbe94f39231c84e6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84e64 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.597116:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21dc200/0xbe94f39231c84e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84e64 expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.597126:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21dc200/0xbe94f39231c84e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e64 expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.597135:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21dc200, rc 0) 00000100:00100000:2.0:1784755981.597829:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190033408:12345-0@lo:400: Request processed in 1158us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755981.597865:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784755981.597892:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190033664 00000100:00100000:2.0:1784755981.597897:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190033664 00000100:00100000:2.0:1784755981.597933:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784755981.597940:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190033664:12345-0@lo:400: 00000100:00100000:2.0:1784755981.597977:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190033664:12345-0@lo:400: Request processed in 38us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755981.597983:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1784755981.598003:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784755981.598306:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc1bdc00 x1871452190033408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755981.598319:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190033408:0@lo:400: 00010000:00080000:2.0:1784755981.598331:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc1bce00 x1871452190033536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755981.598339:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1871452190033536:0@lo:400: 00010000:00080000:2.0:1784755981.598385:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc1bea00 x1871452190033664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784755997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755981.598395:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190033664:0@lo:400: 00000100:00100000:2.0:1784755981.598404:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190033280:0@lo:400: 00010000:00080000:2.0:1784755981.598414:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc1bdf80 x1871452190033792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784755997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755981.598423:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1871452190033792:0@lo:400: 00000100:00100000:1.0:1784755981.599157:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190033920:12345-0@lo:101: Request processed in 2098us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.599166:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:1.0:1784755981.599248:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755981.599463:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190033920:0@lo:101: 00010000:00010000:1.0:1784755981.599483:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.599623:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755981.599697:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190034048:0@lo:501: 00000100:00100000:1.0:1784755981.599747:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755981.599778:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18516b000 going to sleep for 11 seconds 00000100:00100000:1.0:1784755981.599794:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190034048 00000100:00100000:1.0:1784755981.599798:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190034048 00000100:00100000:1.0:1784755981.599861:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784755981.599869:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190034048:12345-0@lo:501: 00000100:00100000:1.0:1784755981.600137:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190034048:12345-0@lo:501: Request processed in 268us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.600144:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784755981.600174:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190034048:0@lo:501: 00000100:00100000:1.0:1784755981.600199:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190034176:0@lo:503: 00000100:00100000:1.0:1784755981.600238:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755981.600693:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18516b000 going to sleep for 11 seconds 00000100:00100000:1.0:1784755981.600757:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190034176 00000100:00100000:1.0:1784755981.600762:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190034176 00000100:00100000:1.0:1784755981.600793:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784755981.600800:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190034176:12345-0@lo:503: 00000100:00100000:1.0:1784755981.601042:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190034176:12345-0@lo:503: Request processed in 242us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.601049:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784755981.601396:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190034176:0@lo:503: 00000100:00100000:2.0:1784755981.601682:0:7839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7839:1871452190034304:0@lo:502: 00000100:00100000:2.0:1784755981.601930:0:7839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.601960:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190034304 00000100:00100000:2.0:1784755981.601965:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190034304 00000100:00100000:2.0:1784755981.601991:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784755981.602000:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:7839:x1871452190034304:12345-0@lo:502: 00000100:00100000:2.0:1784755981.602213:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:7839:x1871452190034304:12345-0@lo:502: Request processed in 214us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755981.602220:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784755981.602952:0:7839:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f187a4d540 going to sleep for 11 seconds 00000100:00100000:2.0:1784755981.602971:0:7839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7839:1871452190034304:0@lo:502: 00000100:00100000:2.0:1784755981.603018:0:7839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7839:1871452190034432:0@lo:502: 00000100:00100000:2.0:1784755981.603055:0:7839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.603102:0:7839:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f187a4d540 going to sleep for 11 seconds 00000100:00100000:3.0:1784755981.603383:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190034432 00000100:00100000:3.0:1784755981.603388:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190034432 00000100:00100000:3.0:1784755981.603423:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784755981.603430:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+14:7839:x1871452190034432:12345-0@lo:502: 00000100:00100000:3.0:1784755981.603692:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+14:7839:x1871452190034432:12345-0@lo:502: Request processed in 262us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755981.603699:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784755981.603992:0:7839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7839:1871452190034432:0@lo:502: 00000040:00080000:0.0:1784755981.604014:0:7839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1784755981.604345:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1784755981.604367:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784755981.604376:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755981.604387:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755981.604395:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784755981.604398:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1784755981.604400:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784755981.604430:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755981.604438:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755981.604447:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755981.604461:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190034560:0@lo:101: 00000100:00100000:2.0:1784755981.604776:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.604868:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f187a4d780 going to sleep for 11 seconds 00000100:00100000:3.0:1784755981.608647:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190034560 00000100:00100000:3.0:1784755981.608661:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190034560 00000100:00100000:3.0:1784755981.610279:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784755981.610295:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190034560:12345-0@lo:101: 00010000:00010000:3.0:1784755981.610312:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755981.610340:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f181500e00/0xbe94f39231c84e79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84e72 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755981.610368:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f181500e00/0xbe94f39231c84e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84e72 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755981.610380:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f181500e00/0xbe94f39231c84e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e72 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755981.610388:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f181500e00, rc 0) 00000100:00100000:3.0:1784755981.610466:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190034560:12345-0@lo:101: Request processed in 177us (5690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755981.610473:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784755981.610680:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190034560:0@lo:101: 00010000:00010000:1.0:1784755981.610698:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.610731:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755981.610798:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190034688:0@lo:501: 00000100:00100000:1.0:1784755981.610847:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755981.613404:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1918e0840 going to sleep for 11 seconds 00000100:00100000:2.0:1784755981.615699:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190034688 00000100:00100000:2.0:1784755981.615779:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190034688 00000100:00100000:2.0:1784755981.615825:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784755981.615856:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190034688:12345-0@lo:501: 00000100:00100000:2.0:1784755981.616859:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190034688:12345-0@lo:501: Request processed in 1022us (6022us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755981.616870:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784755981.616990:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190034688:0@lo:501: 00000100:00100000:0.0:1784755981.617038:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190034816:0@lo:503: 00000100:00100000:0.0:1784755981.617085:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755981.618362:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190034816 00000100:00100000:1.0:1784755981.618370:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190034816 00000100:00100000:0.0:1784755981.618396:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1860329c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755981.618464:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784755981.618473:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190034816:12345-0@lo:503: 00000100:00100000:1.0:1784755981.618748:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190034816:12345-0@lo:503: Request processed in 275us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.618756:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784755981.618817:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190034816:0@lo:503: 00000100:00100000:0.0:1784755981.620475:0:7840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7840:1871452190034944:0@lo:502: 00000100:00100000:0.0:1784755981.620557:0:7840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755981.620596:0:7840:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186032480 going to sleep for 11 seconds 00000100:00100000:2.0:1784755981.620702:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190034944 00000100:00100000:2.0:1784755981.620709:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190034944 00000100:00100000:2.0:1784755981.620763:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784755981.620772:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+15:7840:x1871452190034944:12345-0@lo:502: 00000100:00100000:2.0:1784755981.621037:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+15:7840:x1871452190034944:12345-0@lo:502: Request processed in 265us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755981.621045:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784755981.621208:0:7840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7840:1871452190034944:0@lo:502: 00000020:01000000:0.0:1784755981.621235:0:7840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784755981.621243:0:7840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755981.621251:0:7840:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784755981.621327:0:7840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784755981.621330:0:7840:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784755981.621348:0:7840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7840:1871452190035072:0@lo:502: 00000100:00100000:0.0:1784755981.621380:0:7840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755981.621409:0:7840:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186032480 going to sleep for 11 seconds 00000100:00100000:1.0:1784755981.621462:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190035072 00000100:00100000:1.0:1784755981.621467:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190035072 00000100:00100000:1.0:1784755981.621506:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784755981.621514:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:7840:x1871452190035072:12345-0@lo:502: 00000100:00100000:1.0:1784755981.621641:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:7840:x1871452190035072:12345-0@lo:502: Request processed in 126us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.621649:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784755981.621855:0:7840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7840:1871452190035072:0@lo:502: 00000020:01000000:0.0:1784755981.621875:0:7840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755981.621880:0:7840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755981.621881:0:7840:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784755981.621884:0:7840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1784755981.623059:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1784755981.623083:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784755981.623103:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.623116:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755981.623131:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784755981.623134:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96f18794d800 from 30 10000000:01000000:1.0:1784755981.623137:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784755981.623164:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.623172:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.623180:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755981.623197:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190035200:0@lo:101: 00000100:00100000:1.0:1784755981.623250:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755981.623292:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1918e0840 going to sleep for 11 seconds 00000100:00100000:1.0:1784755981.623309:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190035200 00000100:00100000:1.0:1784755981.623314:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190035200 00000100:00100000:1.0:1784755981.623359:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784755981.623367:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190035200:12345-0@lo:101: 00010000:00010000:1.0:1784755981.623379:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755981.623393:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84e87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84e80 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.624063:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84e80 expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.624074:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e80 expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.624105:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21dc800, rc 0) 00000100:00100000:1.0:1784755981.624167:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190035200:12345-0@lo:101: Request processed in 799us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.624179:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784755981.624682:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190035200:0@lo:101: 00010000:00010000:2.0:1784755981.624703:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755981.624915:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755981.624980:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190035328:0@lo:501: 00000100:00100000:2.0:1784755981.625017:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.625053:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f187a4d600 going to sleep for 11 seconds 00000100:00100000:2.0:1784755981.625069:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190035328 00000100:00100000:2.0:1784755981.625073:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190035328 00000100:00100000:2.0:1784755981.625123:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784755981.625132:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190035328:12345-0@lo:501: 00000100:00100000:2.0:1784755981.625456:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190035328:12345-0@lo:501: Request processed in 324us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755981.625464:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784755981.626368:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190035328:0@lo:501: 00000100:00100000:2.0:1784755981.626410:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190035456:0@lo:503: 00000100:00100000:2.0:1784755981.626457:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.626565:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f187a4d600 going to sleep for 11 seconds 00000100:00100000:2.0:1784755981.626586:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190035456 00000100:00100000:2.0:1784755981.626591:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190035456 00000100:00100000:2.0:1784755981.626617:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784755981.626623:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190035456:12345-0@lo:503: 00000100:00100000:2.0:1784755981.627248:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190035456:12345-0@lo:503: Request processed in 622us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755981.628375:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190035456:0@lo:503: 00000100:00100000:2.0:1784755981.628789:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784755981.629772:0:7842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7842:1871452190035584:0@lo:502: 00000100:00100000:2.0:1784755981.629876:0:7842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.630027:0:7842:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f187a4de40 going to sleep for 11 seconds 00000100:00100000:3.0:1784755981.630121:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190035584 00000100:00100000:3.0:1784755981.630127:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190035584 00000100:00100000:3.0:1784755981.630202:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784755981.630212:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:7842:x1871452190035584:12345-0@lo:502: 00000100:00100000:3.0:1784755981.630567:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:7842:x1871452190035584:12345-0@lo:502: Request processed in 356us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755981.630575:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784755981.630728:0:7842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7842:1871452190035584:0@lo:502: 00000100:00100000:2.0:1784755981.630782:0:7842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7842:1871452190035712:0@lo:502: 00000100:00100000:2.0:1784755981.630822:0:7842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.631085:0:7842:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f187a4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1784755981.631220:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190035712 00000100:00100000:0.0:1784755981.631226:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190035712 00000100:00100000:0.0:1784755981.631263:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784755981.631271:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:7842:x1871452190035712:12345-0@lo:502: 00000100:00100000:0.0:1784755981.631431:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:7842:x1871452190035712:12345-0@lo:502: Request processed in 160us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755981.631437:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784755981.631525:0:7842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7842:1871452190035712:0@lo:502: 00000040:00080000:2.0:1784755981.631547:0:7842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784755981.631753:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784755981.631773:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784755981.631782:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.631793:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755981.631802:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784755981.631805:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff96f18794d800 from 5 10000000:01000000:0.0:1784755981.631807:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784755981.631871:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.631881:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.631891:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84e8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755981.631917:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190035840:0@lo:101: 00000100:00100000:0.0:1784755981.631951:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755981.631979:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186032cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755981.631993:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190035840 00000100:00100000:0.0:1784755981.631997:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190035840 00000100:00100000:0.0:1784755981.632024:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784755981.632032:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190035840:12345-0@lo:101: 00010000:00010000:0.0:1784755981.632041:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755981.632053:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f180030400/0xbe94f39231c84e95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84e8e expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.632074:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f180030400/0xbe94f39231c84e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84e8e expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.632084:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f180030400/0xbe94f39231c84e95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e8e expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.632104:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f180030400, rc 0) 00000100:00100000:0.0:1784755981.632135:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190035840:12345-0@lo:101: Request processed in 104us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755981.632142:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784755981.632198:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190035840:0@lo:101: 00010000:00010000:0.0:1784755981.632210:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e95 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.632219:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84e8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84e95 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755981.632259:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190035968:0@lo:256: 00000100:00100000:0.0:1784755981.632290:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755981.632304:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186032cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755981.632315:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190035968 00000100:00100000:0.0:1784755981.632319:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190035968 00000100:00100000:0.0:1784755981.632339:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784755981.632346:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190035968:12345-0@lo:256: 20000000:01000000:0.0:1784755981.632359:0:5777:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784755981.632374:0:5777:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784755981.632377:0:5777:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1784755981.632444:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190035968:12345-0@lo:256: Request processed in 98us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755981.632451:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784755981.632481:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190035968:0@lo:256: 10000000:01000000:0.0:1784755981.632659:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784755981.632665:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84e8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e95 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.632674:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f180031000/0xbe94f39231c84e8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84e95 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755981.632691:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784755981.632693:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1784755981.632695:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784755981.632711:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.632719:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.632727:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755981.632739:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190036096:0@lo:101: 00000100:00100000:0.0:1784755981.632771:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755981.632790:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186032cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755981.632802:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190036096 00000100:00100000:0.0:1784755981.632805:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190036096 00000100:00100000:0.0:1784755981.632823:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784755981.632829:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190036096:12345-0@lo:101: 00010000:00010000:0.0:1784755981.633536:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755981.633547:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f180031400/0xbe94f39231c84ea3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84e9c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.633566:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f180031400/0xbe94f39231c84ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84e9c expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.633576:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f180031400/0xbe94f39231c84ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e9c expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755981.633595:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f180031400, rc 0) 00000100:00100000:1.0:1784755981.633963:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190036096:0@lo:101: 00010000:00010000:1.0:1784755981.633979:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.633989:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755981.634042:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190036224:0@lo:501: 00000100:00100000:0.0:1784755981.634050:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190036096:12345-0@lo:101: Request processed in 801us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755981.634061:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784755981.634082:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755981.634106:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190036224 00000100:00100000:0.0:1784755981.634111:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190036224 00000100:00100000:1.0:1784755981.634121:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1869aa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755981.634138:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784755981.634147:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190036224:12345-0@lo:501: 00000100:00100000:0.0:1784755981.634378:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190036224:12345-0@lo:501: Request processed in 231us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755981.634384:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784755981.634539:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190036224:0@lo:501: 00000100:00100000:1.0:1784755981.634570:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190036352:0@lo:503: 00000100:00100000:1.0:1784755981.634610:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755981.634625:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1869aa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755981.634637:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190036352 00000100:00100000:1.0:1784755981.634640:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190036352 00000100:00100000:1.0:1784755981.634663:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784755981.634668:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190036352:12345-0@lo:503: 00000100:00100000:1.0:1784755981.634876:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190036352:12345-0@lo:503: Request processed in 207us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.634883:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784755981.634926:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190036352:0@lo:503: 00000100:00100000:1.0:1784755981.637044:0:7844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7844:1871452190036480:0@lo:502: 00000100:00100000:1.0:1784755981.637131:0:7844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755981.637172:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190036480 00000100:00100000:1.0:1784755981.637177:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190036480 00000100:00100000:1.0:1784755981.637220:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784755981.637231:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:7844:x1871452190036480:12345-0@lo:502: 00000100:00100000:1.0:1784755981.637593:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:7844:x1871452190036480:12345-0@lo:502: Request processed in 365us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.637601:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784755981.637649:0:7844:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1869aa000 going to sleep for 11 seconds 00000100:00100000:1.0:1784755981.637670:0:7844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7844:1871452190036480:0@lo:502: 00000020:01000000:1.0:1784755981.637697:0:7844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784755981.637706:0:7844:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784755981.637713:0:7844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755981.637716:0:7844:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784755981.637723:0:7844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784755981.637727:0:7844:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.121@tcp to nid 0x20000c0a8cc79 (192.168.204.121@tcp) 00000020:01000000:1.0:1784755981.637749:0:7844:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784755981.637752:0:7844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784755981.637776:0:7844:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff96f1869b19c0) 00000020:00000080:1.0:1784755981.637797:0:7844:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1784755981.637803:0:7844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784755981.637890:0:7844:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1784755981.637896:0:7844:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784755981.637903:0:7844:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbe94f39231c84eb1 00010000:00080000:1.0:1784755981.637930:0:7844:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96f1bbd01000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.121@tcp at head 00010000:00010000:1.0:1784755981.638166:0:7844:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1784755981.638509:0:7844:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1784755981.638521:0:7844:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784755981.639104:0:7844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784755981.639345:0:7844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784755981.639411:0:7844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1784755981.639489:0:7844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1784755981.644250:0:7845:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784755981.644258:0:7845:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784755981.646018:0:7844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784755981.646034:0:7844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784755981.646068:0:7844:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784755981.646098:0:7844:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbe94f39231c84eb8 00000100:00080000:3.0:1784755981.646109:0:7844:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784755981.646114:0:7844:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff96f1bbd01000 using connection 192.168.204.121@tcp/0@lo 00000100:00100000:3.0:1784755981.646161:0:7844:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96f1851cb800 x1871452190036608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784755981.646191:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1871452190036608:0@lo:8: 00000100:00100000:3.0:1784755981.646255:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784755981.646306:0:7844:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1784755981.646377:0:7844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755981.646381:0:7844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755981.646383:0:7844:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784755981.646386:0:7844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784755981.646390:0:7844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755981.646391:0:7844:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784755981.646393:0:7844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784755981.646395:0:7844:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784755981.646419:0:7844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7844:1871452190036736:0@lo:502: 00000100:00100000:3.0:1784755981.646460:0:7844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755981.646484:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190036736 00000100:00100000:3.0:1784755981.646504:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190036736 00000100:00100000:3.0:1784755981.646543:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784755981.646551:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:7844:x1871452190036736:12345-0@lo:502: 00000100:00100000:3.0:1784755981.646785:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:7844:x1871452190036736:12345-0@lo:502: Request processed in 234us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755981.646793:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784755981.646854:0:7844:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18516b780 going to sleep for 11 seconds 00000100:00100000:3.0:1784755981.646948:0:7844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:7844:1871452190036736:0@lo:502: 00000020:01000000:3.0:1784755981.646970:0:7844:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784755981.646974:0:7844:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784755981.646976:0:7844:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784755981.646979:0:7844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1784755981.647458:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1784755981.647476:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784755981.647495:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.647507:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755981.647517:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784755981.647520:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff96f185184d40 from 1 10000000:01000000:1.0:1784755981.647523:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784755981.647547:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.647555:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.647564:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755981.647579:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190036864:0@lo:101: 00000100:00100000:1.0:1784755981.647612:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755981.647629:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1a270d480 going to sleep for 11 seconds 00000100:00100000:1.0:1784755981.647644:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190036864 00000100:00100000:1.0:1784755981.647647:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190036864 00000100:00100000:1.0:1784755981.647681:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784755981.647687:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190036864:12345-0@lo:101: 00010000:00010000:1.0:1784755981.647696:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755981.647729:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f185038200/0xbe94f39231c84ec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84ebf expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.647749:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f185038200/0xbe94f39231c84ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84ebf expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.647759:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f185038200/0xbe94f39231c84ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84ebf expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.647768:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185038200, rc 0) 00000100:00100000:1.0:1784755981.647797:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190036864:12345-0@lo:101: Request processed in 109us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.647803:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784755981.647853:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190036864:0@lo:101: 00010000:00010000:1.0:1784755981.647865:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.647874:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755981.648060:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190036992:0@lo:501: 00000100:00100000:1.0:1784755981.648086:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755981.648116:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1a270d480 going to sleep for 11 seconds 00000100:00100000:1.0:1784755981.648128:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190036992 00000100:00100000:1.0:1784755981.648131:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190036992 00000100:00100000:1.0:1784755981.648150:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784755981.648163:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190036992:12345-0@lo:501: 00000100:00100000:1.0:1784755981.648356:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190036992:12345-0@lo:501: Request processed in 193us (268us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784755981.648364:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784755981.648391:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190036992:0@lo:501: 10000000:01000000:1.0:1784755981.648409:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784755981.648414:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755981.648422:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755981.649683:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190036608 00000100:00100000:2.0:1784755981.649692:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190036608 00000100:00100000:2.0:1784755981.650403:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784755981.650410:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1871452190036608:12345-0@lo:8: 00010000:00080000:2.0:1784755981.650442:0:6579:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:2.0:1784755981.650471:0:6579:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbe94f39231c84ecd 00002000:00100000:2.0:1784755981.650581:0:6579:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff96f1bf56d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784755981.650586:0:6579:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1784755981.650589:0:6579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1784755981.650715:0:6579:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784755981.651086:0:6579:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784755981.651125:0:6579:0:(import.c:65:import_set_state_nolock()) ffff96f1bf56a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784755981.651269:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1871452190036608:12345-0@lo:8: Request processed in 856us (5012us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755981.651277:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1784755981.651738:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1851cb800 x1871452190036608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784755991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755981.651750:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784755981.651758:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784755981.651766:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784755981.651771:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784755981.651773:0:3299:0:(import.c:65:import_set_state_nolock()) ffff96f1bbd01000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784755981.651798:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784755981.651803:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1871452190036608:0@lo:8: 00000004:00080000:3.0:1784755981.652027:0:7845:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784755981.652168:0:7845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 161818334165ns, next at 0ns, rc = 0 00000004:00080000:3.0:1784755981.720900:0:7846:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1784755981.720932:0:7846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7846:1871452190037248:0@lo:7: 00000100:00100000:3.0:1784755981.721001:0:7846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755981.721046:0:7846:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18516b780 going to sleep for 11 seconds 00000100:00100000:3.0:1784755981.721069:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190037248 00000100:00100000:3.0:1784755981.721075:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190037248 00000100:00100000:3.0:1784755981.721144:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784755981.721154:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7846:x1871452190037248:12345-0@lo:7: 00000100:00100000:1.0:1784755981.724857:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190037120:0@lo:13: 00000100:00100000:1.0:1784755981.724942:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755981.725009:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190037120 00000100:00100000:1.0:1784755981.725016:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190037120 00000100:00100000:1.0:1784755981.725057:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784755981.725066:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1871452190037120:12345-0@lo:13: 00002000:00000024:1.0:1784755981.725111:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1784755981.725154:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1871452190037120:12345-0@lo:13: Request processed in 89us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755981.725161:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784755981.725198:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1851cbb80 x1871452190037120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784755997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755981.725215:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190037120:0@lo:13: 00000100:00080000:2.0:1784755981.726888:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1784755981.727177:0:5804:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1784755981.729634:0:6582:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1784755981.729642:0:6582:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1784755981.729734:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7846:x1871452190037248:12345-0@lo:7: Request processed in 8578us (8729us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755981.729744:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784755981.730294:0:7846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1851c9500 x1871452190037248/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784755997 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755981.730320:0:7846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7846:1871452190037248:0@lo:7: 00000004:00080000:2.0:1784755981.730333:0:7846:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784755981.730371:0:7846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7846:1871452190037376:0@lo:5: 00000100:00100000:2.0:1784755981.730406:0:7846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.730448:0:7846:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f187a4df00 going to sleep for 11 seconds 00000100:00100000:3.0:1784755981.730549:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190037376 00000100:00100000:3.0:1784755981.730556:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190037376 00000100:00100000:3.0:1784755981.730601:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784755981.730609:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7846:x1871452190037376:12345-0@lo:5: 00002000:00080000:3.0:1784755981.730632:0:6579:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784755981.730636:0:6579:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1784755981.730895:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7846:x1871452190037376:12345-0@lo:5: Request processed in 286us (488us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784755981.731038:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784755981.731132:0:7846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc1bce00 x1871452190037376/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784755997 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755981.731144:0:7846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7846:1871452190037376:0@lo:5: 00000004:00080000:2.0:1784755981.731152:0:7846:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1784755981.731177:0:7846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7846:1871452190037504:0@lo:700: 00000100:00100000:2.0:1784755981.731202:0:7846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755981.731226:0:7846:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f187a4df00 going to sleep for 11 seconds 00000100:00100000:3.0:1784755981.731268:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190037504 00000100:00100000:3.0:1784755981.731273:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190037504 00000100:00100000:3.0:1784755981.731305:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784755981.731312:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7846:x1871452190037504:12345-0@lo:700: 00000100:00100000:3.0:1784755981.731339:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6588:1871452190037632:0@lo:700: 00000100:00100000:3.0:1784755981.731374:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755981.734233:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18516b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755981.734283:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190037632 00000100:00100000:1.0:1784755981.734298:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190037632 00000100:00100000:1.0:1784755981.734349:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784755981.734358:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6588:x1871452190037632:12345-0@lo:700: 40000000:02000000:1.0:1784755981.796015:0:5788:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1784755981.802404:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6588:x1871452190037632:12345-0@lo:700: Request processed in 68043us (71023us total) trans 0 rc 0/0 00010000:00080000:3.0:1784755981.802417:0:6588:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1851c8a80 x1871452190037632/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784755997 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755981.802420:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784755981.802438:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6588:1871452190037632:0@lo:700: 40000000:02000000:3.0:1784755981.802452:0:6588:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1784755981.867105:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784755981.867126:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1784755981.870250:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7846:x1871452190037504:12345-0@lo:700: Request processed in 138928us (139037us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755981.870269:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784755981.870453:0:7846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc1bed80 x1871452190037504/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784755997 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755981.870707:0:7846:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784755981.870730:0:7846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7846:1871452190037504:0@lo:700: 00000004:02000040:3.0:1784755981.918364:0:7846:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1784755981.925270:0:7846:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7846:1871452190037760:0@lo:5: 00000100:00100000:3.0:1784755981.925337:0:7846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755981.925391:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190037760 00000100:00100000:3.0:1784755981.925398:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190037760 00000100:00100000:3.0:1784755981.925444:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784755981.925453:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7846:x1871452190037760:12345-0@lo:5: 00000100:00100000:2.0:1784755981.927930:0:7846:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab8f00 going to sleep for 11 seconds 00002000:00080000:3.0:1784755981.931221:0:6582:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1784755981.931241:0:6582:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1784755981.934502:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7846:x1871452190037760:12345-0@lo:5: Request processed in 9042us (9157us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784755981.934515:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784755981.934638:0:7846:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1851c8a80 x1871452190037760/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784755997 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755981.934655:0:7846:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7846:1871452190037760:0@lo:5: 00000004:00080000:2.0:1784755981.934669:0:7846:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1784755982.617158:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755983.641170:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784755984.669429:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755985.689180:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190037888:0@lo:13: 00010000:00010000:3.0:1784755985.689216:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755985.689249:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755985.689507:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190037888 00000100:00100000:3.0:1784755985.689519:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190037888 00000100:00100000:3.0:1784755985.689577:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784755985.689588:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190037888:12345-0@lo:13: 00002000:00000024:3.0:1784755985.689623:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784755985.689627:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784755985.689687:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190037888:12345-0@lo:13: Request processed in 102us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755985.689694:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1784755985.689779:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc1be680 x1871452190037888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755985.689796:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190037888:0@lo:13: 00000001:00080000:1.0:1784755986.000650:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1784755986.397093:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784755986.397224:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170092672 00000100:00100000:1.0:1784755986.397233:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170092672 00000100:00100000:1.0:1784755986.397272:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 110 00000100:00100000:1.0:1784755986.397280:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2346:x1871452170092672:12345-192.168.204.21@tcp:250: 00010000:00080000:1.0:1784755986.397305:0:5774:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 994158a7-52a9-48df-b40e-50a3e29f70de@192.168.204.21@tcp t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:1.0:1784755986.397329:0:5774:0:(genops.c:1406:class_connect()) connect: client 994158a7-52a9-48df-b40e-50a3e29f70de, cookie 0xbe94f39231c84ed4 00000100:00080000:1.0:1784755986.397486:0:5774:0:(import.c:65:import_set_state_nolock()) ffff96f1bbd02800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784755986.397544:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+5:2346:x1871452170092672:12345-192.168.204.21@tcp:250: Request processed in 264us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755986.397551:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 110 00000100:00100000:0.0:1784755986.405794:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784755986.406860:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170092800 00000100:00100000:3.0:1784755986.406884:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170092800 00000100:00100000:3.0:1784755986.406960:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 111 00000100:00100000:3.0:1784755986.406973:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+5:5547:x1871452170092800:12345-192.168.204.21@tcp:101: 00010000:00010000:3.0:1784755986.407006:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755986.407036:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f181500400/0xbe94f39231c84edb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1c84 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.407078:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f181500400/0xbe94f39231c84edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c84 expref: 6 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.407093:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f181500400/0xbe94f39231c84edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c84 expref: 6 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.407109:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f181500400, rc 0) 00000100:00100000:3.0:1784755986.407191:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+6:5547:x1871452170092800:12345-192.168.204.21@tcp:101: Request processed in 219us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.407200:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 111 00000100:00100000:0.0:1784755986.412047:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784755986.412170:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170092928 00000100:00100000:3.0:1784755986.412268:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170092928 00000100:00100000:3.0:1784755986.412360:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 112 00000100:00100000:3.0:1784755986.412375:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+6:5547:x1871452170092928:12345-192.168.204.21@tcp:501: 00000100:00100000:3.0:1784755986.413594:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+6:5547:x1871452170092928:12345-192.168.204.21@tcp:501: Request processed in 1214us (1548us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784755986.413610:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 112 00000100:00100000:1.0:1784755986.420701:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784755986.420882:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170093056 00000100:00100000:3.0:1784755986.420894:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170093056 00000100:00100000:3.0:1784755986.420946:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 113 00000100:00100000:3.0:1784755986.420957:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+6:5547:x1871452170093056:12345-192.168.204.21@tcp:101: 00010000:00010000:3.0:1784755986.420974:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755986.420993:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f181500000/0xbe94f39231c84ee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1c8b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.421078:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f181500000/0xbe94f39231c84ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c8b expref: 7 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.421091:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f181500000/0xbe94f39231c84ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c8b expref: 7 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755986.421100:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f181500000, rc 0) 00000100:00100000:3.0:1784755986.421157:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+7:5547:x1871452170093056:12345-192.168.204.21@tcp:101: Request processed in 200us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.421164:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 113 00000100:00100000:3.0:1784755986.423546:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784755986.423856:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170093184 00000100:00100000:1.0:1784755986.423865:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170093184 00000100:00100000:1.0:1784755986.423913:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 114 00000100:00100000:1.0:1784755986.423934:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+7:5547:x1871452170093184:12345-192.168.204.21@tcp:501: 00000100:00100000:1.0:1784755986.424883:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+8:5547:x1871452170093184:12345-192.168.204.21@tcp:501: Request processed in 944us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755986.424894:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 114 00000100:00100000:0.0:1784755986.429790:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784755986.431369:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170093312 00000100:00100000:3.0:1784755986.431382:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170093312 00000100:00100000:3.0:1784755986.431806:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 115 00000100:00100000:3.0:1784755986.431826:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+8:5547:x1871452170093312:12345-192.168.204.21@tcp:503: 00000100:00100000:3.0:1784755986.432228:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+8:5547:x1871452170093312:12345-192.168.204.21@tcp:503: Request processed in 403us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.432244:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 115 00000100:00100000:0.0:1784755986.437455:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784755986.437567:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170093440 00000100:00100000:1.0:1784755986.437578:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170093440 00000100:00100000:1.0:1784755986.437635:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 116 00000100:00100000:1.0:1784755986.438016:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+8:5566:x1871452170093440:12345-192.168.204.21@tcp:502: 00000100:00100000:1.0:1784755986.438971:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+8:5566:x1871452170093440:12345-192.168.204.21@tcp:502: Request processed in 1322us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755986.438982:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 116 00000100:00100000:0.0:1784755986.455918:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784755986.456007:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170093568 00000100:00100000:1.0:1784755986.456017:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170093568 00000100:00100000:1.0:1784755986.456069:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 117 00000100:00100000:1.0:1784755986.456080:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+8:5566:x1871452170093568:12345-192.168.204.21@tcp:502: 00000100:00100000:1.0:1784755986.456332:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+8:5566:x1871452170093568:12345-192.168.204.21@tcp:502: Request processed in 253us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755986.456339:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 117 00000100:00100000:3.0:1784755986.459929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784755986.460185:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170093696 00000100:00100000:1.0:1784755986.460195:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170093696 00000100:00100000:1.0:1784755986.460243:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 118 00000100:00100000:1.0:1784755986.460253:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+8:5547:x1871452170093696:12345-192.168.204.21@tcp:101: 00010000:00010000:1.0:1784755986.460269:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755986.460286:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f185039400/0xbe94f39231c84ee9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1cb5 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.460330:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f185039400/0xbe94f39231c84ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cb5 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.460340:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f185039400/0xbe94f39231c84ee9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cb5 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.460349:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185039400, rc 0) 00000100:00100000:1.0:1784755986.460402:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+9:5547:x1871452170093696:12345-192.168.204.21@tcp:101: Request processed in 151us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755986.460409:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 118 00000100:00100000:2.0:1784755986.467528:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784755986.467934:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170093824 00000100:00100000:3.0:1784755986.467944:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170093824 00000100:00100000:3.0:1784755986.468047:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 119 00000100:00100000:3.0:1784755986.468058:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+9:5547:x1871452170093824:12345-192.168.204.21@tcp:256: 20000000:01000000:3.0:1784755986.468085:0:5776:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784755986.468109:0:5776:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784755986.468113:0:5776:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784755986.468117:0:5776:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784755986.468120:0:5776:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1784755986.473457:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+9:5547:x1871452170093824:12345-192.168.204.21@tcp:256: Request processed in 5184us (5721us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755986.473475:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 119 00000100:00100000:2.0:1784755986.477208:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784755986.477324:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170093952 00000100:00100000:1.0:1784755986.477335:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170093952 00000100:00100000:1.0:1784755986.477394:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 120 00000100:00100000:1.0:1784755986.477404:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f18508b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+9:5547:x1871452170093952:12345-192.168.204.21@tcp:101: 00010000:00010000:1.0:1784755986.477424:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784755986.477442:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f185038e00/0xbe94f39231c84ef0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1cbc expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.477469:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f185038e00/0xbe94f39231c84ef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cbc expref: 10 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.477480:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f185038e00/0xbe94f39231c84ef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cbc expref: 10 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755986.477501:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185038e00, rc 0) 00000100:00100000:1.0:1784755986.478083:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f18508b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:5547:x1871452170093952:12345-192.168.204.21@tcp:101: Request processed in 675us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755986.478091:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 120 00000100:00100000:2.0:1784755986.485035:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784755986.485130:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170094080 00000100:00100000:1.0:1784755986.485140:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170094080 00000100:00100000:1.0:1784755986.485195:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 121 00000100:00100000:1.0:1784755986.485205:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:5547:x1871452170094080:12345-192.168.204.21@tcp:501: 00000100:00100000:1.0:1784755986.485493:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:5547:x1871452170094080:12345-192.168.204.21@tcp:501: Request processed in 288us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755986.485500:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 121 00000100:00100000:2.0:1784755986.487585:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784755986.487669:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170094208 00000100:00100000:3.0:1784755986.487677:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170094208 00000100:00100000:3.0:1784755986.487737:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 122 00000100:00100000:3.0:1784755986.487746:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:5547:x1871452170094208:12345-192.168.204.21@tcp:503: 00000100:00100000:3.0:1784755986.488263:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:5547:x1871452170094208:12345-192.168.204.21@tcp:503: Request processed in 516us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.488273:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 122 00000100:00100000:2.0:1784755986.493205:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784755986.493443:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170094336 00000100:00100000:3.0:1784755986.493454:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170094336 00000100:00100000:3.0:1784755986.493506:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 123 00000100:00100000:3.0:1784755986.493516:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f18508b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:5571:x1871452170094336:12345-192.168.204.21@tcp:502: 00000100:00100000:3.0:1784755986.493750:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f18508b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:5571:x1871452170094336:12345-192.168.204.21@tcp:502: Request processed in 234us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.493758:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 123 00000100:00100000:2.0:1784755986.498986:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784755986.499118:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170094464 00000100:00100000:0.0:1784755986.499128:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170094464 00000100:00100000:0.0:1784755986.499173:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 124 00000100:00100000:0.0:1784755986.499183:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:5571:x1871452170094464:12345-192.168.204.21@tcp:502: 00000100:00100000:0.0:1784755986.499467:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:5571:x1871452170094464:12345-192.168.204.21@tcp:502: Request processed in 283us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755986.499475:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 124 00000100:00100000:3.0:1784755986.505858:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755986.506160:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170094592 00000100:00100000:2.0:1784755986.506170:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170094592 00000100:00100000:2.0:1784755986.506216:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 4 00000100:00100000:2.0:1784755986.506223:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1871452170094592:12345-192.168.204.21@tcp:38: 00010000:00080000:2.0:1784755986.506255:0:5781:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 633fb912-5a65-4a74-b46a-ec98078e3827@192.168.204.21@tcp t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:2.0:1784755986.506299:0:5781:0:(genops.c:1406:class_connect()) connect: client 633fb912-5a65-4a74-b46a-ec98078e3827, cookie 0xbe94f39231c84ef7 00000004:00100000:2.0:1784755986.506328:0:5781:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1784755986.506334:0:5781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1784755986.540754:0:5781:0:(import.c:65:import_set_state_nolock()) ffff96f1bc59c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784755986.540917:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:2346:x1871452170094592:12345-192.168.204.21@tcp:38: Request processed in 34691us (35107us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755986.540948:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 4 00010000:00010000:3.0:1784755986.713050:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755986.713244:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190038400:0@lo:400: 00000100:00100000:2.0:1784755986.713280:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190038016:0@lo:400: 00000100:00100000:1.0:1784755986.713321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755986.713388:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1871452190038144:0@lo:400: 00000100:00100000:0.0:1784755986.713401:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1871452190038272:0@lo:400: 00000100:00100000:2.0:1784755986.714456:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755986.714538:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1871452190038528:0@lo:400: 00000100:00100000:2.0:1784755986.714579:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755986.714640:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190038400 00000100:00100000:2.0:1784755986.714649:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190038400 00000100:00100000:2.0:1784755986.714709:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755986.714719:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190038400:12345-0@lo:400: 00000100:00100000:2.0:1784755986.714785:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190038400:12345-0@lo:400: Request processed in 66us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755986.714793:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784755986.714821:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190038016 00000100:00100000:2.0:1784755986.714825:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190038016 00000100:00100000:2.0:1784755986.714871:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784755986.714878:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f18508b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3302:x1871452190038016:12345-0@lo:400: 00000100:00100000:2.0:1784755986.714938:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f18508b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3302:x1871452190038016:12345-0@lo:400: Request processed in 60us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755986.714945:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784755986.714984:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190038528 00000100:00100000:2.0:1784755986.714988:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190038528 00000100:00100000:2.0:1784755986.715043:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784755986.715050:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1871452190038528:12345-0@lo:400: 00000100:00100000:2.0:1784755986.715083:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1871452190038528:12345-0@lo:400: Request processed in 33us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755986.715089:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1784755986.715113:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784755986.715151:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190038016:0@lo:400: 00010000:00080000:2.0:1784755986.715168:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53dbb80 x1871452190038528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755986.715180:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1871452190038528:0@lo:400: 00000100:00100000:0.0:1784755986.716311:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755986.716866:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190038272 00000100:00100000:2.0:1784755986.716875:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190038272 00000100:00100000:2.0:1784755986.718049:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784755986.718064:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1871452190038272:12345-0@lo:400: 00000100:00080000:0.0:1784755986.718441:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784755986.718544:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1871452190038272:12345-0@lo:400: Request processed in 483us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755986.718554:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1784755986.718691:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53d9f80 x1871452190038272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755986.718709:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1871452190038272:0@lo:400: 00010000:00080000:1.0:1784755986.722603:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53db800 x1871452190038400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784755986.722622:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190038400:0@lo:400: 00000100:00100000:3.0:1784755986.724179:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755986.724236:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190038656:0@lo:400: 00000100:00100000:3.0:1784755986.724276:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755986.724405:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190038656 00000100:00100000:0.0:1784755986.724412:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190038656 00000100:00100000:0.0:1784755986.724486:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784755986.724496:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190038656:12345-0@lo:400: 00000100:00100000:0.0:1784755986.724555:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190038656:12345-0@lo:400: Request processed in 60us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755986.724562:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1784755986.724612:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53d9500 x1871452190038656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755986.724622:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1784755986.724634:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190038656:0@lo:400: 00000100:00080000:1.0:1784755986.724741:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784755986.725964:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190038144 00000100:00100000:2.0:1784755986.725973:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190038144 00000100:00100000:2.0:1784755986.726036:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784755986.726045:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1871452190038144:12345-0@lo:400: 00000100:00100000:2.0:1784755986.726128:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1871452190038144:12345-0@lo:400: Request processed in 84us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755986.726134:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1784755986.726311:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53daa00 x1871452190038144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784756002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755986.726338:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1871452190038144:0@lo:400: 00000100:00100000:2.0:1784755987.225103:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784755987.225131:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190038784:0@lo:13: 00000100:00100000:2.0:1784755987.225208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755987.229594:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190038784 00000100:00100000:0.0:1784755987.229608:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190038784 00000100:00100000:0.0:1784755987.230786:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784755987.230915:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190038784:12345-0@lo:13: 00002000:00000024:0.0:1784755987.230955:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755987.231091:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190038784:12345-0@lo:13: Request processed in 291us (5883us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755987.231099:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784755987.231942:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc1bfb80 x1871452190038784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755987.231965:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190038784:0@lo:13: 00000100:00100000:1.0:1784755987.549992:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784755987.550110:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170094720 00000100:00100000:0.0:1784755987.550125:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170094720 00000100:00100000:0.0:1784755987.550280:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5 00000100:00100000:0.0:1784755987.550293:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:0:x1871452170094720:12345-192.168.204.21@tcp:41: 00000004:00000024:0.0:1784755987.550335:0:5781:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1784755987.550408:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:0:x1871452170094720:12345-192.168.204.21@tcp:41: Request processed in 117us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755987.550417:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 5 00000100:00100000:3.0:1784755987.550519:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00080000:1.0:1784755987.550660:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784755987.551474:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170094848 00000100:00100000:2.0:1784755987.551483:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170094848 00000100:00100000:2.0:1784755987.551608:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6 00000100:00100000:2.0:1784755987.551618:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:5547:x1871452170094848:12345-192.168.204.21@tcp:41: 00000004:00000024:2.0:1784755987.551649:0:5782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1784755987.551709:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:5547:x1871452170094848:12345-192.168.204.21@tcp:41: Request processed in 92us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755987.551716:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6 00000100:00100000:1.0:1784755987.555703:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784755987.556330:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170094976 00000100:00100000:0.0:1784755987.556345:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170094976 00000100:00100000:0.0:1784755987.556422:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 7 00000100:00100000:0.0:1784755987.556433:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:5547:x1871452170094976:12345-192.168.204.21@tcp:40: 00000100:00100000:0.0:1784755987.556524:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:5547:x1871452170094976:12345-192.168.204.21@tcp:40: Request processed in 92us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755987.556533:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 7 00000100:00100000:2.0:1784755987.560605:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755987.560657:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755987.560697:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755987.560737:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755987.560788:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755987.560884:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170095104 00000100:00100000:2.0:1784755987.560897:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170095104 00000100:00100000:2.0:1784755987.560939:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170095232 00000100:00100000:2.0:1784755987.560942:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170095232 00000100:00100000:2.0:1784755987.560958:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8 00000100:00100000:2.0:1784755987.560968:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1871452170095104:12345-192.168.204.21@tcp:8: 00010000:00080000:2.0:1784755987.561022:0:6579:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 633fb912-5a65-4a74-b46a-ec98078e3827@192.168.204.21@tcp t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:2.0:1784755987.561063:0:6579:0:(genops.c:1406:class_connect()) connect: client 633fb912-5a65-4a74-b46a-ec98078e3827, cookie 0xbe94f39231c84efe 00002000:00100000:2.0:1784755987.561078:0:6579:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 633fb912-5a65-4a74-b46a-ec98078e3827/ffff96f1bc1ef800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784755987.561111:0:6579:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784755987.561546:0:6579:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784755987.561588:0:6579:0:(import.c:65:import_set_state_nolock()) ffff96f1bc1ed000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784755987.561676:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:2346:x1871452170095104:12345-192.168.204.21@tcp:8: Request processed in 706us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755987.561678:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170095488 00000100:00100000:2.0:1784755987.561687:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8 00000100:00100000:0.0:1784755987.561713:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170095488 00000100:00100000:2.0:1784755987.561717:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9 00000100:00100000:2.0:1784755987.561725:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1871452170095232:12345-192.168.204.21@tcp:8: 00010000:00080000:2.0:1784755987.561747:0:6579:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 633fb912-5a65-4a74-b46a-ec98078e3827@192.168.204.21@tcp t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:2.0:1784755987.561771:0:6579:0:(genops.c:1406:class_connect()) connect: client 633fb912-5a65-4a74-b46a-ec98078e3827, cookie 0xbe94f39231c84f05 00002000:00100000:2.0:1784755987.561778:0:6579:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 633fb912-5a65-4a74-b46a-ec98078e3827/ffff96f1bc1eb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784755987.561786:0:6579:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1784755987.561806:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 126 00000100:00100000:0.0:1784755987.562076:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170095488:12345-192.168.204.21@tcp:400: 00002000:00080000:2.0:1784755987.562095:0:6579:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784755987.562116:0:6579:0:(import.c:65:import_set_state_nolock()) ffff96f1bc1ed800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784755987.562148:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:2346:x1871452170095232:12345-192.168.204.21@tcp:8: Request processed in 422us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755987.562170:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9 00000100:00100000:0.0:1784755987.562225:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170095488:12345-192.168.204.21@tcp:400: Request processed in 406us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755987.562235:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 126 00000100:00100000:1.0:1784755987.562373:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170095616 00000100:00100000:1.0:1784755987.562381:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170095616 00000100:00100000:1.0:1784755987.562437:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 16 00000100:00100000:1.0:1784755987.562445:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170095616:12345-192.168.204.21@tcp:400: 00000100:00100000:1.0:1784755987.562497:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170095616:12345-192.168.204.21@tcp:400: Request processed in 54us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755987.562504:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 16 00000100:00100000:3.0:1784755987.563101:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170095360 00000100:00100000:3.0:1784755987.563108:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170095360 00000100:00100000:3.0:1784755987.563157:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 0 00000100:00100000:3.0:1784755987.563166:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:5547:x1871452170095360:12345-192.168.204.21@tcp:33: 00000004:00080000:3.0:1784755987.586730:0:5784:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23488us 00000004:00200000:3.0:1784755987.600154:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784755987.601163:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:5547:x1871452170095360:12345-192.168.204.21@tcp:33: Request processed in 37986us (40573us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755987.601177:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 0 00000100:00100000:2.0:1784755987.735518:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784755987.735905:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170095744 00000100:00100000:1.0:1784755987.735918:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170095744 00000100:00100000:1.0:1784755987.736016:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8 00000100:00100000:1.0:1784755987.736029:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:5589:x1871452170095744:12345-192.168.204.21@tcp:101: 00010000:00010000:1.0:1784755987.736064:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755987.737079:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755987.737612:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185039a00/0xbe94f39231c84f0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1ce6 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755987.737695:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c84f13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755987.737709:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c84f13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755987.737723:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c84f13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784755987.738287:0:6601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784755987.738293:0:6601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784755987.738428:0:6601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c84f13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755987.738458:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185039a00/0xbe94f39231c84f0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1ce6 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755987.738475:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c84f13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1ce6 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755987.738490:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097100) 00010000:00010000:1.0:1784755987.738493:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784755987.738496:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185038a00, rc 0) 00000100:00100000:1.0:1784755987.738570:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+7:5589:x1871452170095744:12345-192.168.204.21@tcp:101: Request processed in 2543us (3066us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755987.738578:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8 00010000:00010000:3.0:1784755988.761011:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755989.675630:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784755989.675777:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170095872 00000100:00100000:1.0:1784755989.675787:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170095872 00000100:00100000:1.0:1784755989.675912:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 9 00000100:00100000:1.0:1784755989.675924:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+7:5641:x1871452170095872:12345-192.168.204.21@tcp:41: 00000004:00000024:1.0:1784755989.675980:0:5783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1784755989.676053:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+7:5641:x1871452170095872:12345-192.168.204.21@tcp:41: Request processed in 130us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755989.676061:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 9 00000100:00080000:0.0:1784755989.676270:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784755989.681127:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784755989.681210:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170096000 00000100:00100000:3.0:1784755989.681220:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170096000 00000100:00100000:3.0:1784755989.681287:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 7 00000100:00100000:3.0:1784755989.681297:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:633fb912-5a65-4a74-b46a-ec98078e3827+6:5641:x1871452170096000:12345-192.168.204.21@tcp:13: 00002000:00000024:3.0:1784755989.681337:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784755989.681423:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:633fb912-5a65-4a74-b46a-ec98078e3827+6:5641:x1871452170096000:12345-192.168.204.21@tcp:13: Request processed in 127us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755989.681431:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 7 00000100:00080000:0.0:1784755989.682381:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784755989.688142:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784755989.688234:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170096128 00000100:00100000:1.0:1784755989.688244:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170096128 00000100:00100000:1.0:1784755989.688316:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8 00000100:00100000:1.0:1784755989.688326:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:633fb912-5a65-4a74-b46a-ec98078e3827+6:5641:x1871452170096128:12345-192.168.204.21@tcp:13: 00002000:00000024:1.0:1784755989.688365:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784755989.688436:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:633fb912-5a65-4a74-b46a-ec98078e3827+6:5641:x1871452170096128:12345-192.168.204.21@tcp:13: Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755989.688443:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8 00000100:00080000:0.0:1784755989.688509:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784755989.785131:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755990.808947:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190038912:0@lo:13: 00000100:00100000:2.0:1784755990.809068:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755990.809146:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190038912 00000100:00100000:2.0:1784755990.809153:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190038912 00000100:00100000:2.0:1784755990.809207:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784755990.809217:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190038912:12345-0@lo:13: 00002000:00000024:2.0:1784755990.809238:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784755990.809281:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190038912:12345-0@lo:13: Request processed in 65us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755990.809289:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1784755990.809308:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784755990.809336:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc1bea00 x1871452190038912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755990.809353:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190038912:0@lo:13: 00010000:00010000:2.0:1784755990.814476:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755991.834276:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1871452190039168:0@lo:400: 00000100:00100000:0.0:1784755991.834358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755991.834406:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190039168 00000100:00100000:1.0:1784755991.834415:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190039168 00000100:00100000:0.0:1784755991.834427:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190039680:0@lo:400: 00000100:00100000:0.0:1784755991.834458:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755991.834477:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784755991.834494:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784755991.834501:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190039040:0@lo:400: 00000100:00100000:1.0:1784755991.834518:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1871452190039168:12345-0@lo:400: 00000100:00100000:0.0:1784755991.834533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755991.834555:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1871452190039552:0@lo:400: 00000100:00100000:1.0:1784755991.834584:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1871452190039168:12345-0@lo:400: Request processed in 71us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755991.834586:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755991.834597:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784755991.834617:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190039552 00000100:00100000:1.0:1784755991.834621:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190039552 00000100:00100000:0.0:1784755991.834626:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1871452190039168:0@lo:400: 00000100:00100000:0.0:1784755991.834660:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190039680 00000100:00100000:0.0:1784755991.834664:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190039680 00000100:00100000:1.0:1784755991.834666:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784755991.834676:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1871452190039552:12345-0@lo:400: 00000100:00100000:0.0:1784755991.834703:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784755991.834713:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190039680:12345-0@lo:400: 00000100:00100000:1.0:1784755991.834718:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1871452190039552:12345-0@lo:400: Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755991.834726:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784755991.834755:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190039680:12345-0@lo:400: Request processed in 44us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755991.834772:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784755991.834798:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190039040 00000100:00100000:0.0:1784755991.834801:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190039040 00000100:00100000:0.0:1784755991.834855:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784755991.834862:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3303:x1871452190039040:12345-0@lo:400: 00000100:00100000:0.0:1784755991.834893:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3303:x1871452190039040:12345-0@lo:400: Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755991.834916:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784755991.835794:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190039040:0@lo:400: 00000100:00100000:0.0:1784755991.835813:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1871452190039552:0@lo:400: 00010000:00080000:0.0:1784755991.835824:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53daa00 x1871452190039680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755991.835852:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190039680:0@lo:400: 00000100:00100000:0.0:1784755991.836160:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190039424:0@lo:400: 00000100:00100000:0.0:1784755991.836211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755991.836245:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784755991.836254:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1871452190039296:0@lo:400: 00000100:00100000:0.0:1784755991.836279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755991.836319:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190039424 00000100:00100000:0.0:1784755991.836324:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190039424 00000100:00100000:0.0:1784755991.836366:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784755991.836374:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190039424:12345-0@lo:400: 00000100:00100000:0.0:1784755991.836439:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190039424:12345-0@lo:400: Request processed in 64us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755991.836447:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784755991.836502:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53d9180 x1871452190039424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755991.836513:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190039424:0@lo:400: 00000100:00100000:0.0:1784755991.836551:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190039296 00000100:00100000:0.0:1784755991.836555:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190039296 00000100:00100000:0.0:1784755991.836590:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784755991.836600:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1871452190039296:12345-0@lo:400: 00000100:00100000:0.0:1784755991.836645:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1871452190039296:12345-0@lo:400: Request processed in 47us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755991.836652:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784755991.836683:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1871452190039296:0@lo:400: 00000100:00080000:0.0:1784755991.836709:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784755991.836713:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784755991.840050:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784755991.900602:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 633fb912-5a65-4a74-b46a-ec98078e3827 00000001:00100000:1.0:1784755991.903349:0:5804:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 633fb912-5a65-4a74-b46a-ec98078e3827 00000001:02000400:2.0:1784755992.214432:0:8148:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1784755992.345331:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784755992.345358:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190039808:0@lo:13: 00000100:00100000:0.0:1784755992.345432:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755992.345499:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190039808 00000100:00100000:0.0:1784755992.345506:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190039808 00000100:00100000:0.0:1784755992.345553:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784755992.345562:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190039808:12345-0@lo:13: 00002000:00000024:0.0:1784755992.345597:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755992.345641:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190039808:12345-0@lo:13: Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755992.345648:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1784755992.345696:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc1bea00 x1871452190039808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755992.345732:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190039808:0@lo:13: 00000001:00100000:1.0:1784755992.409922:0:6606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 633fb912-5a65-4a74-b46a-ec98078e3827 00000100:00100000:2.0:1784755992.585185:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755992.585235:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755992.585279:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755992.585335:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755992.585371:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170096512 00000100:00100000:1.0:1784755992.585372:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170096384 00000100:00100000:2.0:1784755992.585381:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170096512 00000100:00100000:1.0:1784755992.585381:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170096384 00000100:00100000:3.0:1784755992.585445:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170096640 00000100:00100000:3.0:1784755992.585450:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170096640 00000100:00100000:0.0:1784755992.585506:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170096256 00000100:00100000:0.0:1784755992.585511:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170096256 00000100:00100000:0.0:1784755992.585574:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 128 00000100:00100000:0.0:1784755992.585587:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170096256:12345-192.168.204.21@tcp:400: 00000100:00100000:0.0:1784755992.585660:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170096256:12345-192.168.204.21@tcp:400: Request processed in 76us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755992.585668:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 128 00000100:00100000:2.0:1784755992.585903:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 7 00000100:00100000:2.0:1784755992.585912:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:633fb912-5a65-4a74-b46a-ec98078e3827+5:2347:x1871452170096512:12345-192.168.204.21@tcp:400: 00000100:00100000:2.0:1784755992.586501:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:633fb912-5a65-4a74-b46a-ec98078e3827+5:2347:x1871452170096512:12345-192.168.204.21@tcp:400: Request processed in 588us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755992.586510:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 7 00000100:00100000:3.0:1784755992.587634:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8 00000100:00100000:3.0:1784755992.587646:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+5:2347:x1871452170096640:12345-192.168.204.21@tcp:400: 00000100:00100000:3.0:1784755992.587724:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+5:2347:x1871452170096640:12345-192.168.204.21@tcp:400: Request processed in 80us (2388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755992.587731:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8 00000100:00100000:2.0:1784755992.588146:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 20 00000100:00100000:2.0:1784755992.588157:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2347:x1871452170096384:12345-192.168.204.21@tcp:400: 00000100:00100000:2.0:1784755992.588194:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2347:x1871452170096384:12345-192.168.204.21@tcp:400: Request processed in 40us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755992.588200:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 20 00000100:00080000:0.0:1784755992.589473:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784755992.589480:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784755992.589483:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784755992.857533:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784755993.882352:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755994.905016:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784755995.814636:0:8297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeba1b75b0 20000000:00000080:0.0:1784755995.814654:0:8297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96f1bc465400 uarg=0000000000000000 20000000:01000000:0.0:1784755995.814697:0:8297:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1784755995.814699:0:8297:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1784755995.814702:0:8297:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784755995.814707:0:8297:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784755995.814711:0:8297:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1784755995.814723:0:8297:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784755995.814726:0:8297:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784755995.814980:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784755995.814984:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784755995.816270:0:8298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1784755995.817972:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1784755995.818039:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1784755995.818071:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1784755995.818083:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784755995.818085:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1784755995.819477:0:8299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1784755995.820001:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1784755995.820040:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1784755995.820081:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1784755995.820093:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784755995.820096:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1784755995.822113:0:8300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1784755995.823279:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1784755995.823343:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1784755995.823380:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1784755995.823395:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784755995.823398:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1784755995.824585:0:8301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1784755995.825321:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1784755995.825387:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1784755995.825426:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1784755995.825451:0:8297:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784755995.825471:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825601:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84e17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e10 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825611:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e3a expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825618:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f1c21dc200/0xbe94f39231c84e6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e64 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825624:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f181500e00/0xbe94f39231c84e79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e72 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825630:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84e87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e80 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825636:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f180031400/0xbe94f39231c84ea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e9c expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825643:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f185038200/0xbe94f39231c84ec6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84ebf expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825652:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f181500400/0xbe94f39231c84edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c84 expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825660:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f181500000/0xbe94f39231c84ee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c8b expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825668:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825716:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f181500000/0xbe94f39231c84ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c8b expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.825975:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96f181500000/0xbe94f39231c84ee2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c8b expref: 9 pid: 5776 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755995.825993:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190039936:192.168.204.21@tcp:104: 00010000:00010000:3.0:1784755995.826108:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f181500400/0xbe94f39231c84edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c84 expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.826118:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96f181500400/0xbe94f39231c84edb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c84 expref: 9 pid: 5776 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755995.826128:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040064:192.168.204.21@tcp:104: 00010000:00010000:3.0:1784755995.826162:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f185038200/0xbe94f39231c84ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84ebf expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.826171:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f185038200/0xbe94f39231c84ec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84ebf expref: 18 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755995.826180:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040192:0@lo:104: 00000100:00100000:3.0:1784755995.826220:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784755995.826481:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f180031400/0xbe94f39231c84ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84e9c expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.826500:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f180031400/0xbe94f39231c84ea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84e9c expref: 18 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755995.826522:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040320:0@lo:104: 00000100:00100000:3.0:1784755995.826557:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784755995.829808:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84e80 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.829851:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84e87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84e80 expref: 18 pid: 5776 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755995.829866:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bbd16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040448:0@lo:104: 00010000:00010000:3.0:1784755995.829929:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f181500e00/0xbe94f39231c84e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84e72 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.829937:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f181500e00/0xbe94f39231c84e79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84e72 expref: 18 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755995.829945:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040576:0@lo:104: 00010000:00010000:3.0:1784755995.829965:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f1c21dc200/0xbe94f39231c84e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84e64 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.829972:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f1c21dc200/0xbe94f39231c84e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84e64 expref: 18 pid: 5774 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755995.829979:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc580380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040704:0@lo:104: 00010000:00010000:3.0:1784755995.829995:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84e3a expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.830002:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84e3a expref: 18 pid: 5774 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755995.830019:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc580700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040832:0@lo:104: 00010000:00010000:3.0:1784755995.830038:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84e10 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.830045:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84e17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84e10 expref: 18 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755995.830052:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040960:0@lo:104: 00000100:00100000:3.0:1784755995.830067:0:8297:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f182d95540 going to sleep for 11 seconds 00000100:00100000:3.0:1784755995.830523:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190039936:192.168.204.21@tcp:104: 00000100:00100000:3.0:1784755995.830533:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040064:192.168.204.21@tcp:104: 00000100:00100000:0.0:1784755995.837146:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784755995.837195:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755995.837224:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755995.837237:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755995.837279:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755995.837293:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755995.837303:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190040192 00000100:00100000:0.0:1784755995.837311:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190040192 00000100:00100000:0.0:1784755995.837359:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190040320 00000100:00100000:0.0:1784755995.837363:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190040320 00000100:00100000:0.0:1784755995.837373:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190040448 00000100:00100000:0.0:1784755995.837375:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190040448 00000100:00100000:0.0:1784755995.837384:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190040576 00000100:00100000:0.0:1784755995.837386:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190040576 00000100:00100000:0.0:1784755995.837394:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190040704 00000100:00100000:0.0:1784755995.837396:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190040704 00000100:00100000:0.0:1784755995.837404:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190040832 00000100:00100000:0.0:1784755995.837406:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190040832 00000100:00100000:0.0:1784755995.837413:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190040960 00000100:00100000:0.0:1784755995.837415:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190040960 00000100:00100000:0.0:1784755995.837427:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784755995.837435:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+9:8297:x1871452190040192:12345-0@lo:104: 00010000:00010000:0.0:1784755995.837453:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.837559:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784755995.837565:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+9:8297:x1871452190040192:12345-0@lo:104: Request processed in 131us (11345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.837572:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784755995.837596:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784755995.837603:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc463050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+8:8297:x1871452190040320:12345-0@lo:104: 00010000:00010000:0.0:1784755995.837611:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.837645:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784755995.837656:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc463050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+8:8297:x1871452190040320:12345-0@lo:104: Request processed in 54us (11098us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.837662:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784755995.837703:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784755995.837710:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+7:8297:x1871452190040448:12345-0@lo:104: 00010000:00010000:0.0:1784755995.837718:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.837928:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784755995.837935:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.837944:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21dd200 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:2.0:1784755995.837948:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.837957:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755995.837964:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755995.837970:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755995.838008:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838014:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755995.838044:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838052:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd200/0xbe94f39231c84ebf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84ec6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838070:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784755995.838073:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838079:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f180030e00 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:2.0:1784755995.838082:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838090:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755995.838096:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755995.838117:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755995.838131:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838137:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755995.838152:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838159:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f180030e00/0xbe94f39231c84e9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84ea3 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838170:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755995.838179:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755995.838181:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755995.838348:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784755995.838356:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+7:8297:x1871452190040448:12345-0@lo:104: Request processed in 646us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.838363:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784755995.838383:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784755995.838391:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+6:8297:x1871452190040576:12345-0@lo:104: 00010000:00010000:0.0:1784755995.838400:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.838428:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784755995.838433:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+6:8297:x1871452190040576:12345-0@lo:104: Request processed in 45us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.838439:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784755995.838452:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784755995.838457:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+5:8297:x1871452190040704:12345-0@lo:104: 00010000:00010000:0.0:1784755995.838465:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.838492:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784755995.838503:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+5:8297:x1871452190040704:12345-0@lo:104: Request processed in 46us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.838509:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784755995.838523:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1784755995.838600:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784755995.838605:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838612:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21dd800 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:2.0:1784755995.838615:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838622:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755995.838627:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755995.838632:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755995.838648:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838654:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755995.838661:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838667:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f1c21dd800/0xbe94f39231c84e80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e87 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838677:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784755995.838680:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838697:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21dfe00 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:2.0:1784755995.838700:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838707:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755995.838713:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755995.838718:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755995.838743:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838749:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755995.838754:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838760:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f1c21dfe00/0xbe94f39231c84e72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e79 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838770:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784755995.838773:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838779:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21dca00 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:2.0:1784755995.838783:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838801:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784755995.838808:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755995.838813:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784755995.838862:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838869:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784755995.838873:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838879:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f1c21dca00/0xbe94f39231c84e64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e6b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.838890:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755995.838892:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784755995.838893:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755995.839097:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+4:8297:x1871452190040832:12345-0@lo:104: 00010000:00010000:0.0:1784755995.839106:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839155:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784755995.839160:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+4:8297:x1871452190040832:12345-0@lo:104: Request processed in 631us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.839166:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784755995.839182:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784755995.839188:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:8297:x1871452190040960:12345-0@lo:104: 00010000:00010000:0.0:1784755995.839195:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839218:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784755995.839222:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:8297:x1871452190040960:12345-0@lo:104: Request processed in 36us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.839240:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1784755995.839271:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784755995.839275:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839282:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21ddc00 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:0.0:1784755995.839285:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839303:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755995.839309:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755995.839314:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784755995.839329:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839335:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755995.839339:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839346:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f1c21ddc00/0xbe94f39231c84e3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e41 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839355:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784755995.839358:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839364:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181501200 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:0.0:1784755995.839367:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839374:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784755995.839380:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755995.839391:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784755995.839403:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839408:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784755995.839413:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839419:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f181501200/0xbe94f39231c84e10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e17 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.839432:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755995.839434:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755995.839435:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755995.839458:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190041088:0@lo:103: 00000100:00100000:0.0:1784755995.839496:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784755995.839698:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784755995.840308:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190041600:0@lo:103: 00000100:00100000:0.0:1784755995.840344:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755995.840619:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040192:0@lo:104: 00000100:00100000:3.0:1784755995.840630:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd15500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040320:0@lo:104: 00000100:00100000:3.0:1784755995.840637:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bbd16d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040448:0@lo:104: 00000100:00100000:3.0:1784755995.840646:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040576:0@lo:104: 00000100:00100000:3.0:1784755995.840653:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc580380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040704:0@lo:104: 00000100:00100000:3.0:1784755995.840661:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc580700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040832:0@lo:104: 00000100:00100000:3.0:1784755995.840668:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1871452190040960:0@lo:104: 00010000:00010000:3.0:1784755995.840707:0:8297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755995.840889:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784755995.840897:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190041472:0@lo:103: 00000100:00100000:0.0:1784755995.840921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755995.842279:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1784755995.842672:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190041088 00000100:00100000:2.0:1784755995.842682:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190041088 00010000:00010000:2.0:1784755995.842723:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f185038200/0xbe94f39231c84ec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84ebf expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755995.842767:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190041600 00000100:00100000:2.0:1784755995.842771:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190041600 00010000:00010000:2.0:1784755995.842782:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f1c21dc200/0xbe94f39231c84e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e64 expref: 20 pid: 5774 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755995.842810:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190041472 00000100:00100000:2.0:1784755995.842813:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190041472 00010000:00010000:2.0:1784755995.842851:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f181500e00/0xbe94f39231c84e79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e72 expref: 21 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755995.842865:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784755995.842874:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+21:3301:x1871452190041088:12345-0@lo:103: 00010000:00010000:2.0:1784755995.842888:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755995.842893:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff96f185038200/0xbe94f39231c84ec6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84ebf expref: 21 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.842903:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f185038200/0xbe94f39231c84ec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84ebf expref: 21 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.842919:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f185038200/0xbe94f39231c84ec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84ebf expref: 21 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.842934:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755995.842988:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+20:3301:x1871452190041088:12345-0@lo:103: Request processed in 115us (3491us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755995.842994:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784755995.843010:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784755995.843015:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190041600:12345-0@lo:103: 00010000:00010000:2.0:1784755995.843021:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755995.843025:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff96f1c21dc200/0xbe94f39231c84e6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e64 expref: 19 pid: 5774 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.843032:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f1c21dc200/0xbe94f39231c84e6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84e64 expref: 19 pid: 5774 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.843047:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f1c21dc200/0xbe94f39231c84e6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84e64 expref: 19 pid: 5774 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.843056:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755995.843076:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+18:3301:x1871452190041600:12345-0@lo:103: Request processed in 62us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755995.843081:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784755995.843092:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784755995.843097:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+17:3301:x1871452190041472:12345-0@lo:103: 00010000:00010000:2.0:1784755995.843103:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784755995.843107:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff96f181500e00/0xbe94f39231c84e79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e72 expref: 17 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.843114:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f181500e00/0xbe94f39231c84e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84e72 expref: 17 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.843122:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f181500e00/0xbe94f39231c84e79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84e72 expref: 17 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755995.843130:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784755995.843149:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+16:3301:x1871452190041472:12345-0@lo:103: Request processed in 52us (2228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755995.843154:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784755995.843395:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190041472:0@lo:103: 00000100:00100000:0.0:1784755995.843404:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190041088:0@lo:103: 00000100:00100000:0.0:1784755995.843410:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190041600:0@lo:103: 00000100:00100000:0.0:1784755995.843444:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190041216:0@lo:103: 00000100:00100000:0.0:1784755995.843498:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755995.843522:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190041728:0@lo:103: 00000100:00100000:0.0:1784755995.843552:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755995.843575:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784755995.843581:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190041344:0@lo:103: 00000100:00100000:0.0:1784755995.843599:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755995.843608:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190041856:0@lo:103: 00000100:00100000:0.0:1784755995.843621:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755995.843645:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784755995.843684:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784755995.843699:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190041216 00000100:00100000:0.0:1784755995.843702:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190041216 00010000:00010000:0.0:1784755995.843719:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f180031400/0xbe94f39231c84ea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e9c expref: 16 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755995.843741:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190041728 00000100:00100000:0.0:1784755995.843744:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190041728 00010000:00010000:0.0:1784755995.843755:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e3a expref: 17 pid: 5774 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755995.843764:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190041344 00000100:00100000:0.0:1784755995.843766:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190041344 00010000:00010000:0.0:1784755995.843774:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84e87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e80 expref: 18 pid: 5776 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755995.843784:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190041856 00000100:00100000:0.0:1784755995.843786:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190041856 00010000:00010000:0.0:1784755995.843795:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84e17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e10 expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755995.843828:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170096768 00000100:00100000:0.0:1784755995.843853:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170096768 00010000:00010000:0.0:1784755995.843869:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f181500000/0xbe94f39231c84ee2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c8b expref: 10 pid: 5776 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755995.843881:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170096896 00000100:00100000:0.0:1784755995.843884:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170096896 00010000:00010000:0.0:1784755995.843896:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f181500400/0xbe94f39231c84edb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c84 expref: 11 pid: 5776 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755995.843908:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784755995.843914:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3302:x1871452190041216:12345-0@lo:103: 00010000:00010000:0.0:1784755995.843922:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755995.843927:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff96f180031400/0xbe94f39231c84ea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e9c expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.843934:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f180031400/0xbe94f39231c84ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84e9c expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.843945:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f180031400/0xbe94f39231c84ea3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84e9c expref: 19 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.843956:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755995.843985:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+18:3302:x1871452190041216:12345-0@lo:103: Request processed in 72us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.843991:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784755995.844008:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784755995.844014:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+17:3302:x1871452190041728:12345-0@lo:103: 00010000:00010000:0.0:1784755995.844028:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755995.844032:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e3a expref: 17 pid: 5774 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844039:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84e3a expref: 17 pid: 5774 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844049:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f180031a00/0xbe94f39231c84e41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84e3a expref: 17 pid: 5774 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844057:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755995.844077:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+16:3302:x1871452190041728:12345-0@lo:103: Request processed in 64us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.844083:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784755995.844095:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784755995.844101:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+15:3302:x1871452190041344:12345-0@lo:103: 00010000:00010000:0.0:1784755995.844107:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755995.844111:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84e87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e80 expref: 15 pid: 5776 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844118:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84e87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84e80 expref: 15 pid: 5776 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844128:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f1c21dc800/0xbe94f39231c84e87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84e80 expref: 15 pid: 5776 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844135:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755995.844155:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+14:3302:x1871452190041344:12345-0@lo:103: Request processed in 54us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.844161:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784755995.844182:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784755995.844188:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+13:3302:x1871452190041856:12345-0@lo:103: 00010000:00010000:0.0:1784755995.844195:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755995.844200:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84e17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e10 expref: 13 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844208:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84e10 expref: 13 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844218:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f1c21df600/0xbe94f39231c84e17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84e10 expref: 13 pid: 5777 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844228:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755995.844248:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+12:3302:x1871452190041856:12345-0@lo:103: Request processed in 61us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.844254:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784755995.844270:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 19 00000100:00100000:0.0:1784755995.844276:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1838afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994158a7-52a9-48df-b40e-50a3e29f70de+11:2347:x1871452170096768:12345-192.168.204.21@tcp:103: 00010000:00010000:0.0:1784755995.844284:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755995.844288:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff96f181500000/0xbe94f39231c84ee2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c8b expref: 11 pid: 5776 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844299:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f181500000/0xbe94f39231c84ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c8b expref: 11 pid: 5776 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844309:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f181500000/0xbe94f39231c84ee2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c8b expref: 11 pid: 5776 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844317:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755995.844364:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1838afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170096768:12345-192.168.204.21@tcp:103: Request processed in 87us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.844371:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 19 00000100:00100000:0.0:1784755995.844405:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 20 00000100:00100000:0.0:1784755995.844412:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994158a7-52a9-48df-b40e-50a3e29f70de+9:2347:x1871452170096896:12345-192.168.204.21@tcp:103: 00010000:00010000:0.0:1784755995.844418:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784755995.844423:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff96f181500400/0xbe94f39231c84edb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c84 expref: 9 pid: 5776 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844431:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f181500400/0xbe94f39231c84edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c84 expref: 9 pid: 5776 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844440:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f181500400/0xbe94f39231c84edb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1c84 expref: 9 pid: 5776 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844450:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844459:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844472:0:5767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844480:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844487:0:5767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844494:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844507:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181500600 already unused, calling callback (ffffffffc1436230) 00010000:00010000:0.0:1784755995.844512:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844520:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844536:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.844548:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784755995.844568:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994158a7-52a9-48df-b40e-50a3e29f70de+8:2347:x1871452170096896:12345-192.168.204.21@tcp:103: Request processed in 157us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755995.844575:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 20 00000100:00100000:0.0:1784755995.844726:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190041344:0@lo:103: 00000100:00100000:0.0:1784755995.844736:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190041856:0@lo:103: 00000100:00100000:0.0:1784755995.844742:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190041216:0@lo:103: 00000100:00100000:0.0:1784755995.844749:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190041728:0@lo:103: 00010000:00010000:3.0:1784755995.845662:0:8297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.845676:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755995.845695:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f181500600/0xbe94f39231c84f1a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755995.928965:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784755995.929138:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784755995.929161:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190041984:0@lo:13: 00000100:00100000:1.0:1784755995.929268:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755995.930691:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190041984 00000100:00100000:1.0:1784755995.930701:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190041984 00000100:00080000:2.0:1784755995.930731:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784755995.930774:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784755995.930784:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190041984:12345-0@lo:13: 00002000:00000024:1.0:1784755995.930869:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784755995.931121:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190041984:12345-0@lo:13: Request processed in 337us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755995.931129:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1784755995.931150:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53d9500 x1871452190041984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784755995.931172:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190041984:0@lo:13: 00010000:00010000:0.0:1784755996.953180:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784755996.953245:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190042368:0@lo:400: 00000100:00100000:3.0:1784755996.953576:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190042496:0@lo:400: 00000100:00100000:3.0:1784755996.953623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755996.953687:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784755996.953693:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190042112:0@lo:400: 00000100:00100000:3.0:1784755996.953717:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755996.953738:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190042624:0@lo:400: 00000100:00100000:2.0:1784755996.953756:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755996.953765:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190042496 00000100:00100000:3.0:1784755996.953773:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190042496 00000100:00100000:2.0:1784755996.953808:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784755996.953818:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1871452190042240:0@lo:400: 00000100:00100000:3.0:1784755996.953848:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784755996.953857:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190042496:12345-0@lo:400: 00000100:00100000:2.0:1784755996.953890:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755996.953915:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190042752:0@lo:400: 00000100:00100000:3.0:1784755996.953926:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190042496:12345-0@lo:400: Request processed in 69us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755996.953933:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784755996.953943:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755996.954039:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190042368 00000100:00100000:1.0:1784755996.954044:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190042368 00000100:00100000:1.0:1784755996.954077:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190042240 00000100:00100000:1.0:1784755996.954080:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190042240 00000100:00100000:3.0:1784755996.954082:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190042752 00000100:00100000:3.0:1784755996.954089:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190042752 00000100:00100000:1.0:1784755996.954103:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784755996.954114:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190042368:12345-0@lo:400: 00000100:00100000:3.0:1784755996.954120:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784755996.954130:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190042752:12345-0@lo:400: 00000100:00100000:1.0:1784755996.954158:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190042368:12345-0@lo:400: Request processed in 46us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755996.954165:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784755996.954173:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190042752:12345-0@lo:400: Request processed in 44us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755996.954184:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784755996.954184:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784755996.954194:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1871452190042240:12345-0@lo:400: 00000100:00100000:3.0:1784755996.954208:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190042112 00000100:00100000:3.0:1784755996.954213:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190042112 00000100:00100000:1.0:1784755996.954226:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1871452190042240:12345-0@lo:400: Request processed in 34us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755996.954234:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784755996.954245:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1784755996.954254:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784755996.954261:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784755996.954262:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:3300:x1871452190042112:12345-0@lo:400: 00000100:00100000:3.0:1784755996.954300:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+12:3300:x1871452190042112:12345-0@lo:400: Request processed in 40us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755996.954306:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784755996.954343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784755996.954374:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1ae1dea00 x1871452190042496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784755996.954387:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190042496:0@lo:400: 00000100:00100000:3.0:1784755996.954405:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190042112:0@lo:400: 00000100:00100000:3.0:1784755996.954445:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190042624 00000100:00100000:3.0:1784755996.954449:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190042624 00000100:00100000:3.0:1784755996.954477:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1784755996.954491:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1ae1df800 x1871452190042752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755996.954501:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190042752:0@lo:400: 00000100:00100000:2.0:1784755996.954514:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190042368:0@lo:400: 00000100:00100000:2.0:1784755996.954529:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1871452190042240:0@lo:400: 00000100:00100000:3.0:1784755996.954621:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190042624:12345-0@lo:400: 00000100:00100000:3.0:1784755996.954664:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190042624:12345-0@lo:400: Request processed in 180us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755996.954670:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784755996.954696:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190042624:0@lo:400: 00000100:00080000:1.0:1784755996.955074:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1784755997.272922:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784755997.272930:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96f1abd8c000 from 39 10000000:01000000:0.0:1784755997.272952:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784755997.272999:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f186aad000/0xbe94f39231c84f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.273011:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f186aad000/0xbe94f39231c84f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.273021:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f186aad000/0xbe94f39231c84f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755997.273046:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190042880:0@lo:101: 00000100:00100000:0.0:1784755997.273118:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.273186:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784755997.273299:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190042880 00000100:00100000:2.0:1784755997.273308:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190042880 00000100:00100000:2.0:1784755997.273369:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784755997.273379:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+12:5779:x1871452190042880:12345-0@lo:101: 00010000:00010000:2.0:1784755997.273393:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755997.273406:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21df000/0xbe94f39231c84f28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84f21 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.273429:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21df000/0xbe94f39231c84f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84f21 expref: 13 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.273439:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21df000/0xbe94f39231c84f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84f21 expref: 13 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.273448:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21df000, rc 0) 00000100:00100000:2.0:1784755997.273617:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:5779:x1871452190042880:12345-0@lo:101: Request processed in 239us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755997.273625:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784755997.273722:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190042880:0@lo:101: 00010000:00010000:0.0:1784755997.273736:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f186aad000/0xbe94f39231c84f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f28 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.273746:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f186aad000/0xbe94f39231c84f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84f28 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755997.273814:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190043008:0@lo:501: 00000100:00100000:0.0:1784755997.273863:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.273900:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.274069:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190043008 00000100:00100000:3.0:1784755997.274075:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190043008 00000100:00100000:3.0:1784755997.274115:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784755997.274123:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+13:5779:x1871452190043008:12345-0@lo:501: 00000100:00100000:3.0:1784755997.275108:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+13:5779:x1871452190043008:12345-0@lo:501: Request processed in 983us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.275118:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784755997.278470:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190043008:0@lo:501: 00000100:00100000:0.0:1784755997.278715:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190043136:0@lo:503: 00000100:00100000:0.0:1784755997.278807:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.278942:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784755997.285707:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190043136 00000100:00100000:2.0:1784755997.285722:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190043136 00000100:00100000:2.0:1784755997.285899:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784755997.285912:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:5779:x1871452190043136:12345-0@lo:503: 00000100:00100000:2.0:1784755997.286197:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:5779:x1871452190043136:12345-0@lo:503: Request processed in 287us (7389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755997.286206:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784755997.286315:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190043136:0@lo:503: 00000100:00100000:0.0:1784755997.290191:0:8316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8316:1871452190043264:0@lo:502: 00000100:00100000:0.0:1784755997.290289:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.290338:0:8316:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.291947:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190043264 00000100:00100000:3.0:1784755997.291990:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190043264 00000100:00100000:3.0:1784755997.292049:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784755997.292060:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+13:8316:x1871452190043264:12345-0@lo:502: 00000100:00100000:3.0:1784755997.292377:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+13:8316:x1871452190043264:12345-0@lo:502: Request processed in 318us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.292384:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784755997.292709:0:8316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8316:1871452190043264:0@lo:502: 00000100:00100000:0.0:1784755997.292778:0:8316:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8316:1871452190043392:0@lo:502: 00000100:00100000:0.0:1784755997.292856:0:8316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.292895:0:8316:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784755997.293214:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190043392 00000100:00100000:1.0:1784755997.293220:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190043392 00000100:00100000:1.0:1784755997.293252:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784755997.293259:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+13:8316:x1871452190043392:12345-0@lo:502: 00000100:00100000:1.0:1784755997.293465:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+13:8316:x1871452190043392:12345-0@lo:502: Request processed in 205us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755997.293472:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784755997.293690:0:8316:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8316:1871452190043392:0@lo:502: 00000040:00080000:0.0:1784755997.293717:0:8316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1784755997.294064:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1784755997.294081:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784755997.294092:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f186aad000/0xbe94f39231c84f21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f28 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755997.294103:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f186aad000/0xbe94f39231c84f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f28 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784755997.294113:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784755997.294116:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1784755997.294119:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784755997.294145:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181500600/0xbe94f39231c84f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755997.294153:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f181500600/0xbe94f39231c84f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755997.294162:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f181500600/0xbe94f39231c84f2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784755997.294177:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc580380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190043520:0@lo:101: 00000100:00100000:3.0:1784755997.294211:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755997.294245:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f182d95900 going to sleep for 11 seconds 00000100:00100000:2.0:1784755997.294330:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190043520 00000100:00100000:2.0:1784755997.294335:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190043520 00000100:00100000:2.0:1784755997.294581:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784755997.294589:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+13:5779:x1871452190043520:12345-0@lo:101: 00010000:00010000:2.0:1784755997.294599:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755997.294613:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21df800/0xbe94f39231c84f36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84f2f expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.294634:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21df800/0xbe94f39231c84f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84f2f expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.294645:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21df800/0xbe94f39231c84f36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84f2f expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.294653:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21df800, rc 0) 00000100:00100000:2.0:1784755997.294826:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190043520:12345-0@lo:101: Request processed in 237us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755997.294857:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784755997.297757:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc580380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190043520:0@lo:101: 00010000:00010000:0.0:1784755997.297803:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f181500600/0xbe94f39231c84f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f36 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.297818:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f181500600/0xbe94f39231c84f2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84f36 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755997.297931:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190043648:0@lo:501: 00000100:00100000:0.0:1784755997.298322:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755997.298499:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190043648 00000100:00100000:1.0:1784755997.298507:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190043648 00000100:00100000:1.0:1784755997.298553:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784755997.298562:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190043648:12345-0@lo:501: 00000100:00100000:1.0:1784755997.307434:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190043648:12345-0@lo:501: Request processed in 8862us (9102us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755997.307451:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784755997.307759:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755997.307786:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190043648:0@lo:501: 00000100:00100000:0.0:1784755997.307870:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190043776:0@lo:503: 00000100:00100000:0.0:1784755997.307926:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.307958:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.308126:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190043776 00000100:00100000:3.0:1784755997.308140:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190043776 00000100:00100000:3.0:1784755997.308190:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784755997.308199:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190043776:12345-0@lo:503: 00000100:00100000:3.0:1784755997.308405:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190043776:12345-0@lo:503: Request processed in 207us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.308413:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784755997.308924:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190043776:0@lo:503: 00000100:00100000:1.0:1784755997.309253:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8317:1871452190043904:0@lo:502: 00000100:00100000:1.0:1784755997.309298:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755997.309330:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e780 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.309547:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190043904 00000100:00100000:3.0:1784755997.309553:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190043904 00000100:00100000:3.0:1784755997.309629:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784755997.309637:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:8317:x1871452190043904:12345-0@lo:502: 00000100:00100000:3.0:1784755997.309828:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+14:8317:x1871452190043904:12345-0@lo:502: Request processed in 191us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.309911:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784755997.310003:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8317:1871452190043904:0@lo:502: 00000020:01000000:1.0:1784755997.310029:0:8317:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784755997.310037:0:8317:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755997.310040:0:8317:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784755997.310045:0:8317:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784755997.310066:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8317:1871452190044032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784755997.310100:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755997.317277:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e780 going to sleep for 11 seconds 00000100:00100000:2.0:1784755997.317489:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190044032 00000100:00100000:2.0:1784755997.317498:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190044032 00000100:00100000:2.0:1784755997.317549:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784755997.317559:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+14:8317:x1871452190044032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784755997.317873:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+14:8317:x1871452190044032:12345-0@lo:502:llog_process_th.0 Request processed in 314us (7770us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755997.317881:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784755997.318183:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8317:1871452190044032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784755997.318216:0:8317:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784755997.318224:0:8317:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784755997.318227:0:8317:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784755997.318231:0:8317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1784755997.318649:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1784755997.318669:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784755997.318679:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181500600/0xbe94f39231c84f2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f36 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.318690:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f181500600/0xbe94f39231c84f2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f36 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784755997.318699:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784755997.318701:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96f1bc39f800 from 39 10000000:01000000:2.0:1784755997.318704:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784755997.318736:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21df600/0xbe94f39231c84f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.318744:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f1c21df600/0xbe94f39231c84f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.318753:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f1c21df600/0xbe94f39231c84f3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755997.318773:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190044160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784755997.318827:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755997.318894:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1869aaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.319319:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190044160 00000100:00100000:3.0:1784755997.319326:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190044160 00000100:00100000:3.0:1784755997.319503:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784755997.319513:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+14:5779:x1871452190044160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784755997.319525:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755997.319538:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f181501800/0xbe94f39231c84f44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84f3d expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755997.319560:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f181501800/0xbe94f39231c84f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84f3d expref: 15 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755997.319569:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f181501800/0xbe94f39231c84f44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84f3d expref: 15 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755997.319578:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f181501800, rc 0) 00000100:00100000:3.0:1784755997.319634:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190044160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.319640:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784755997.319819:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190044160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784755997.319865:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f1c21df600/0xbe94f39231c84f3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f44 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.319880:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f1c21df600/0xbe94f39231c84f3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84f44 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755997.319947:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190044288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784755997.320129:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755997.320163:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1869aaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.320318:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190044288 00000100:00100000:3.0:1784755997.320323:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190044288 00000100:00100000:3.0:1784755997.320514:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784755997.320522:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190044288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784755997.320788:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190044288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.320806:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784755997.320878:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190044288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784755997.320912:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190044416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784755997.320962:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755997.321338:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1869aaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784755997.321548:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190044416 00000100:00100000:0.0:1784755997.321554:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190044416 00000100:00100000:0.0:1784755997.321592:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784755997.321599:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190044416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784755997.321774:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190044416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755997.321781:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784755997.321933:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190044416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784755997.324898:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8318:1871452190044544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784755997.324984:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755997.325032:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1869aa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784755997.325104:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190044544 00000100:00100000:0.0:1784755997.325111:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190044544 00000100:00100000:0.0:1784755997.325146:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784755997.325155:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:8318:x1871452190044544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755997.325402:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:8318:x1871452190044544:12345-0@lo:502:llog_process_th.0 Request processed in 246us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755997.325410:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784755997.326571:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8318:1871452190044544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784755997.326639:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8318:1871452190044672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784755997.326691:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755997.326733:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1871a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784755997.326785:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190044672 00000100:00100000:0.0:1784755997.326800:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190044672 00000100:00100000:0.0:1784755997.326859:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784755997.326867:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:8318:x1871452190044672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755997.327073:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:8318:x1871452190044672:12345-0@lo:502:llog_process_th.0 Request processed in 207us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755997.327081:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784755997.327210:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8318:1871452190044672:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784755997.327230:0:8318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784755997.327590:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1784755997.327609:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784755997.327618:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21df600/0xbe94f39231c84f3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f44 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.327629:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f1c21df600/0xbe94f39231c84f3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f44 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755997.327652:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784755997.327655:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1784755997.327657:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784755997.327684:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f186aac600/0xbe94f39231c84f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.327692:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f186aac600/0xbe94f39231c84f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.327701:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f186aac600/0xbe94f39231c84f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755997.327717:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190044800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784755997.327749:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.327785:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab8240 going to sleep for 11 seconds 00000100:00100000:2.0:1784755997.327872:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190044800 00000100:00100000:2.0:1784755997.327877:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190044800 00000100:00100000:2.0:1784755997.327904:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784755997.327918:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+15:5779:x1871452190044800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784755997.334207:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755997.334235:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21dfe00/0xbe94f39231c84f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84f4b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.334274:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21dfe00/0xbe94f39231c84f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84f4b expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.334285:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21dfe00/0xbe94f39231c84f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84f4b expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.334293:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21dfe00, rc 0) 00000100:00100000:2.0:1784755997.334394:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190044800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6475us (6643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755997.334403:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784755997.334756:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190044800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755997.334777:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f186aac600/0xbe94f39231c84f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f52 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755997.334813:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f186aac600/0xbe94f39231c84f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84f52 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755997.334914:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190044928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755997.334953:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755997.335213:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e780 going to sleep for 11 seconds 00000100:00100000:1.0:1784755997.335232:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190044928 00000100:00100000:1.0:1784755997.335238:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190044928 00000100:00100000:1.0:1784755997.335317:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784755997.335327:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190044928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755997.335603:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190044928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1784755997.335626:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784755997.336927:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190044928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784755997.337208:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190045056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784755997.337277:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755997.337328:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1871a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784755997.337884:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190045056 00000100:00100000:0.0:1784755997.337892:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190045056 00000100:00100000:0.0:1784755997.338124:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784755997.338135:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190045056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784755997.338361:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190045056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755997.338368:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784755997.338414:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190045056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784755997.342023:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8319:1871452190045184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784755997.342129:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755997.342192:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1a0e39000 going to sleep for 11 seconds 00000100:00100000:0.0:1784755997.342279:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190045184 00000100:00100000:0.0:1784755997.342292:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190045184 00000100:00100000:0.0:1784755997.342349:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784755997.342368:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:8319:x1871452190045184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755997.342808:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:8319:x1871452190045184:12345-0@lo:502:llog_process_th.0 Request processed in 441us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755997.342821:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784755997.343098:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8319:1871452190045184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784755997.343130:0:8319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784755997.343144:0:8319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784755997.343146:0:8319:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784755997.343153:0:8319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784755997.343175:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8319:1871452190045312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784755997.343227:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755997.343258:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1871a9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.343639:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190045312 00000100:00100000:3.0:1784755997.343645:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190045312 00000100:00100000:3.0:1784755997.343688:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784755997.343697:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+16:8319:x1871452190045312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784755997.343913:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+16:8319:x1871452190045312:12345-0@lo:502:llog_process_th.0 Request processed in 217us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755997.344004:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8319:1871452190045312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784755997.344030:0:8319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755997.344037:0:8319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755997.344039:0:8319:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784755997.344043:0:8319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000100:00100000:3.0:1784755997.344187:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000020:01000000:1.0:1784755997.344326:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1784755997.344476:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784755997.344552:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f186aac600/0xbe94f39231c84f4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f52 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755997.344564:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f186aac600/0xbe94f39231c84f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f52 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755997.344575:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784755997.344577:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96f18794d800 from 39 10000000:01000000:1.0:1784755997.344581:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784755997.344610:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f185039a00/0xbe94f39231c84f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755997.344629:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f185039a00/0xbe94f39231c84f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755997.344640:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f185039a00/0xbe94f39231c84f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755997.344660:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190045440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784755997.344699:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755997.344768:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784755997.346474:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190045440 00000100:00100000:0.0:1784755997.346486:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190045440 00000100:00100000:0.0:1784755997.346637:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784755997.346649:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190045440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784755997.346665:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784755997.346685:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f186aac400/0xbe94f39231c84f60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84f59 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.346711:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f186aac400/0xbe94f39231c84f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84f59 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.346722:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f186aac400/0xbe94f39231c84f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84f59 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.346731:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aac400, rc 0) 00000100:00100000:0.0:1784755997.346807:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190045440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755997.346896:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784755997.347000:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190045440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755997.347018:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f185039a00/0xbe94f39231c84f59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f60 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755997.347027:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f185039a00/0xbe94f39231c84f59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84f60 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755997.347095:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190045568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755997.347128:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784755997.347750:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190045568 00000100:00100000:3.0:1784755997.347758:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190045568 00000100:00100000:1.0:1784755997.347774:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e900 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.347805:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784755997.347830:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190045568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784755997.348138:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190045568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.348145:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784755997.348228:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190045568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755997.348264:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190045696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784755997.348303:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755997.348326:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e900 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.348427:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190045696 00000100:00100000:3.0:1784755997.348432:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190045696 00000100:00100000:3.0:1784755997.348452:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784755997.348465:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190045696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784755997.348611:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190045696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.348629:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784755997.348738:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190045696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784755997.352516:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8320:1871452190045824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755997.352606:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.352699:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.352937:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190045824 00000100:00100000:3.0:1784755997.352944:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190045824 00000100:00100000:3.0:1784755997.353555:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784755997.353566:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:8320:x1871452190045824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784755997.353876:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:8320:x1871452190045824:12345-0@lo:502:llog_process_th.0 Request processed in 311us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.353885:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784755997.353952:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8320:1871452190045824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784755997.354024:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8320:1871452190045952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784755997.354063:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.355546:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190045952 00000100:00100000:0.0:1784755997.355559:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190045952 00000100:00100000:1.0:1784755997.355582:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e000 going to sleep for 11 seconds 00000100:00100000:0.0:1784755997.355608:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784755997.355618:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+17:8320:x1871452190045952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755997.355907:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+17:8320:x1871452190045952:12345-0@lo:502:llog_process_th.0 Request processed in 289us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755997.355916:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784755997.356162:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8320:1871452190045952:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784755997.356195:0:8320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784755997.356363:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1784755997.356381:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784755997.356391:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f185039a00/0xbe94f39231c84f59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f60 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.356402:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f185039a00/0xbe94f39231c84f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f60 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784755997.356412:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784755997.356414:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1784755997.356417:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784755997.356447:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f186aace00/0xbe94f39231c84f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.356456:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f186aace00/0xbe94f39231c84f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784755997.356465:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f186aace00/0xbe94f39231c84f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784755997.356483:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190046080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784755997.356519:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.356560:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.356607:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190046080 00000100:00100000:3.0:1784755997.356612:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190046080 00000100:00100000:3.0:1784755997.356675:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784755997.356683:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190046080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784755997.356692:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784755997.356704:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f181501000/0xbe94f39231c84f6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84f67 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755997.356726:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f181501000/0xbe94f39231c84f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84f67 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755997.356736:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f181501000/0xbe94f39231c84f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84f67 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784755997.356745:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f181501000, rc 0) 00000100:00100000:3.0:1784755997.356785:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190046080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.356809:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784755997.356895:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190046080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755997.356909:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f186aace00/0xbe94f39231c84f67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f6e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755997.356919:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f186aace00/0xbe94f39231c84f67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84f6e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755997.357160:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190046208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755997.357190:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755997.358092:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e000 going to sleep for 11 seconds 00000100:00100000:0.0:1784755997.358318:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190046208 00000100:00100000:0.0:1784755997.358326:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190046208 00000100:00100000:0.0:1784755997.358364:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784755997.358373:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190046208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784755997.358703:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190046208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 330us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755997.358711:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784755997.358945:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190046208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755997.359149:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190046336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784755997.359195:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755997.359222:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e000 going to sleep for 11 seconds 00000100:00100000:2.0:1784755997.361131:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190046336 00000100:00100000:2.0:1784755997.361143:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190046336 00000100:00100000:2.0:1784755997.361200:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784755997.361210:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190046336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784755997.361582:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190046336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 372us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755997.361590:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784755997.362894:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190046336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784755997.364442:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8321:1871452190046464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784755997.364518:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784755997.364568:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1909ec000 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.364766:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190046464 00000100:00100000:3.0:1784755997.364774:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190046464 00000100:00100000:3.0:1784755997.364859:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784755997.364869:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:8321:x1871452190046464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784755997.365274:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:8321:x1871452190046464:12345-0@lo:502:llog_process_th.0 Request processed in 405us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.365283:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784755997.365391:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8321:1871452190046464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784755997.365423:0:8321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784755997.365431:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755997.365434:0:8321:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784755997.365439:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784755997.365470:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8321:1871452190046592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784755997.365508:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.365541:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b4ab86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784755997.365763:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190046592 00000100:00100000:2.0:1784755997.365769:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190046592 00000100:00100000:2.0:1784755997.365807:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784755997.365814:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:8321:x1871452190046592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784755997.366035:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:8321:x1871452190046592:12345-0@lo:502:llog_process_th.0 Request processed in 221us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755997.366042:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784755997.366081:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8321:1871452190046592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784755997.366105:0:8321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784755997.366110:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784755997.366112:0:8321:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784755997.366116:0:8321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1784755997.366360:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1784755997.366378:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784755997.366388:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f186aace00/0xbe94f39231c84f67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f6e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755997.366411:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f186aace00/0xbe94f39231c84f67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f6e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784755997.366420:0:5779:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784755997.366422:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff96f185184d40 from 1 10000000:01000000:1.0:1784755997.366425:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784755997.366450:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f185039e00/0xbe94f39231c84f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755997.366457:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f185039e00/0xbe94f39231c84f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755997.366466:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f185039e00/0xbe94f39231c84f75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755997.366482:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190046720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784755997.366513:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755997.366542:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e000 going to sleep for 11 seconds 00000100:00100000:2.0:1784755997.366584:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190046720 00000100:00100000:2.0:1784755997.366589:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190046720 00000100:00100000:2.0:1784755997.366618:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784755997.366625:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190046720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784755997.366645:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784755997.366657:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21df200/0xbe94f39231c84f7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84f75 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.366679:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21df200/0xbe94f39231c84f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84f75 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.366688:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21df200/0xbe94f39231c84f7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84f75 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784755997.366696:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21df200, rc 0) 00000100:00100000:2.0:1784755997.366741:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190046720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784755997.366747:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784755997.367175:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190046720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784755997.367189:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f185039e00/0xbe94f39231c84f75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f7c expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755997.367197:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f185039e00/0xbe94f39231c84f75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84f7c expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784755997.367239:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190046848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784755997.367263:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784755997.367288:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e000 going to sleep for 11 seconds 00000100:00100000:3.0:1784755997.367344:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190046848 00000100:00100000:3.0:1784755997.367349:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190046848 00000100:00100000:3.0:1784755997.367380:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784755997.367387:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190046848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784755997.367616:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190046848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (350us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784755997.367622:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784755997.367743:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190046848:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784755997.367763:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784755997.367769:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f185039e00/0xbe94f39231c84f75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f7c expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784755997.367778:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f185039e00/0xbe94f39231c84f75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84f7c expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784755997.465762:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190046976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784755997.466070:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784755997.466573:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190046976 00000100:00100000:0.0:1784755997.466581:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190046976 00000100:00100000:0.0:1784755997.466636:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784755997.466645:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190046976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784755997.466681:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784755997.466740:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190046976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755997.466759:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1784755997.467161:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1ae1df800 x1871452190046976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784755997.467182:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190046976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784755997.706545:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755997.706601:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784755997.706703:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170097152 00000100:00100000:3.0:1784755997.706713:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170097152 00000100:00100000:3.0:1784755997.706798:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 24 00000100:00100000:3.0:1784755997.706809:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170097152:12345-192.168.204.21@tcp:400: 00000100:00100000:3.0:1784755997.706930:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170097152:12345-192.168.204.21@tcp:400: Request processed in 122us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.706938:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 24 00000100:00080000:1.0:1784755997.707285:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784755997.707713:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170097024 00000100:00100000:0.0:1784755997.707719:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170097024 00000100:00100000:0.0:1784755997.707771:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 162 00000100:00100000:0.0:1784755997.707780:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+8:2350:x1871452170097024:12345-192.168.204.21@tcp:400: 00000100:00100000:0.0:1784755997.707864:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+8:2350:x1871452170097024:12345-192.168.204.21@tcp:400: Request processed in 84us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784755997.707871:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 162 00000100:00100000:2.0:1784755997.713487:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784755997.713540:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784755997.713701:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170097408 00000100:00100000:3.0:1784755997.713711:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170097408 00000100:00100000:3.0:1784755997.713791:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170097280 00000100:00100000:3.0:1784755997.713795:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170097280 00000100:00100000:3.0:1784755997.713860:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 11 00000100:00100000:3.0:1784755997.713872:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:633fb912-5a65-4a74-b46a-ec98078e3827+5:2349:x1871452170097408:12345-192.168.204.21@tcp:400: 00000100:00100000:3.0:1784755997.713973:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:633fb912-5a65-4a74-b46a-ec98078e3827+5:2349:x1871452170097408:12345-192.168.204.21@tcp:400: Request processed in 103us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.713981:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 11 00000100:00100000:3.0:1784755997.713998:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 12 00000100:00100000:3.0:1784755997.714004:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:633fb912-5a65-4a74-b46a-ec98078e3827+5:2349:x1871452170097280:12345-192.168.204.21@tcp:400: 00000100:00100000:3.0:1784755997.714030:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:633fb912-5a65-4a74-b46a-ec98078e3827+5:2349:x1871452170097280:12345-192.168.204.21@tcp:400: Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784755997.714036:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 12 00000100:00080000:1.0:1784755997.715196:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784755997.715205:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784755997.980482:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784755999.001100:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756000.025064:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756001.049221:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756001.049391:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784756001.049412:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190047104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756001.049479:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756001.049600:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190047104 00000100:00100000:2.0:1784756001.049620:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190047104 00000100:00100000:2.0:1784756001.049686:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784756001.049696:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190047104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756001.049756:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756001.049809:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190047104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756001.049816:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1784756001.050023:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53d8e00 x1871452190047104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756001.050042:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190047104:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784756001.050160:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784756002.073192:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756002.074461:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190047488:0@lo:400:kworker.0 00000100:00100000:1.0:1784756002.074536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756002.074601:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784756002.074608:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1871452190047360:0@lo:400:kworker.0 00000100:00100000:1.0:1784756002.074636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756002.074664:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190047872:0@lo:400:kworker.0 00000100:00100000:3.0:1784756002.074670:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190047616:0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.074682:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190047488 00000100:00100000:2.0:1784756002.074691:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190047488 00000100:00100000:1.0:1784756002.074710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756002.074798:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190047232:0@lo:400:kworker.0 00000100:00100000:0.0:1784756002.076405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756002.076446:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190047744:0@lo:400:kworker.0 00000100:00100000:0.0:1784756002.076475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756002.078990:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190047872 00000100:00100000:3.0:1784756002.079005:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190047872 00000100:00100000:3.0:1784756002.079079:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784756002.079091:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190047872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756002.079191:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190047872:12345-0@lo:400:kworker.0 Request processed in 102us (4492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756002.079199:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784756002.079228:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190047232 00000100:00100000:3.0:1784756002.079232:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190047232 00000100:00100000:3.0:1784756002.079257:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784756002.079264:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190047232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756002.079370:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190047232:12345-0@lo:400:kworker.0 Request processed in 106us (2969us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756002.079377:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784756002.081667:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190047232:0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.083754:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190047360 00000100:00100000:2.0:1784756002.083769:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190047360 00000100:00100000:2.0:1784756002.083822:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190047744 00000100:00100000:2.0:1784756002.083825:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190047744 00000100:00100000:2.0:1784756002.083863:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784756002.083873:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190047488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.083965:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190047488:12345-0@lo:400:kworker.0 Request processed in 94us (9429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.083972:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784756002.083989:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784756002.083994:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1871452190047360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.084024:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1871452190047360:12345-0@lo:400:kworker.0 Request processed in 30us (9388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.084030:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784756002.084041:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784756002.084047:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190047744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.084088:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190047744:12345-0@lo:400:kworker.0 Request processed in 41us (7612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.084094:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1784756002.084115:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784756002.084120:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756002.084456:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190047744:0@lo:400:kworker.0 00000100:00100000:0.0:1784756002.084528:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1871452190047360:0@lo:400:kworker.0 00010000:00080000:0.0:1784756002.084544:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53daa00 x1871452190047872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756002.084554:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190047872:0@lo:400:kworker.0 00000100:00100000:0.0:1784756002.084567:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190047488:0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.087755:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756002.087823:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190047616 00000100:00100000:2.0:1784756002.087849:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190047616 00000100:00100000:2.0:1784756002.087914:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784756002.087924:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190047616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756002.088009:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190047616:12345-0@lo:400:kworker.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.088016:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1784756002.088056:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53d8a80 x1871452190047616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756002.088070:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190047616:0@lo:400:kworker.0 00000100:00100000:1.0:1784756002.308615:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756002.308863:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170097536 00000100:00100000:2.0:1784756002.308874:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170097536 00000100:00100000:2.0:1784756002.308931:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 164 00000100:00100000:2.0:1784756002.308942:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+8:5561:x1871452170097536:12345-192.168.204.21@tcp:101: 00010000:00010000:2.0:1784756002.308959:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756002.308976:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21dfa00/0xbe94f39231c84f83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1ced expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756002.309006:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21dfa00/0xbe94f39231c84f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1ced expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756002.309018:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21dfa00/0xbe94f39231c84f83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1ced expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756002.309029:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21dfa00, rc 0) 00000100:00100000:2.0:1784756002.309100:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+9:5561:x1871452170097536:12345-192.168.204.21@tcp:101: Request processed in 159us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.309124:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 164 00000100:00100000:3.0:1784756002.313016:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756002.313870:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170097664 00000100:00100000:0.0:1784756002.313883:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170097664 00000100:00100000:0.0:1784756002.313953:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 165 00000100:00100000:0.0:1784756002.313963:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+9:5561:x1871452170097664:12345-192.168.204.21@tcp:501: 00000100:00100000:0.0:1784756002.314299:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+9:5561:x1871452170097664:12345-192.168.204.21@tcp:501: Request processed in 335us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756002.314308:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 165 00000100:00100000:0.0:1784756002.319554:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756002.324179:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170097792 00000100:00100000:3.0:1784756002.324203:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170097792 00000100:00100000:3.0:1784756002.324314:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 166 00000100:00100000:3.0:1784756002.324328:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+9:5561:x1871452170097792:12345-192.168.204.21@tcp:503: 00000100:00100000:3.0:1784756002.325187:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+9:5561:x1871452170097792:12345-192.168.204.21@tcp:503: Request processed in 856us (5645us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756002.325200:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 166 00000100:00100000:1.0:1784756002.345442:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756002.345569:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170097920 00000100:00100000:2.0:1784756002.345580:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170097920 00000100:00100000:2.0:1784756002.345643:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 167 00000100:00100000:2.0:1784756002.345653:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+9:6060:x1871452170097920:12345-192.168.204.21@tcp:502: 00000100:00100000:2.0:1784756002.346021:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+9:6060:x1871452170097920:12345-192.168.204.21@tcp:502: Request processed in 367us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.346030:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 167 00000100:00100000:0.0:1784756002.353970:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756002.354170:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170098048 00000100:00100000:3.0:1784756002.354183:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170098048 00000100:00100000:3.0:1784756002.354258:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 168 00000100:00100000:3.0:1784756002.354270:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+9:6060:x1871452170098048:12345-192.168.204.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784756002.354949:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+9:6060:x1871452170098048:12345-192.168.204.21@tcp:502:llog_process_th.0 Request processed in 677us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756002.354959:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 168 00000100:00100000:1.0:1784756002.357800:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756002.358830:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170098176 00000100:00100000:2.0:1784756002.358894:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170098176 00000100:00100000:2.0:1784756002.358964:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 169 00000100:00100000:2.0:1784756002.358978:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+9:5561:x1871452170098176:12345-192.168.204.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756002.358996:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756002.359019:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21dec00/0xbe94f39231c84f8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1cf4 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756002.359051:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21dec00/0xbe94f39231c84f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cf4 expref: 10 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756002.359064:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21dec00/0xbe94f39231c84f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cf4 expref: 10 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756002.359073:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21dec00, rc 0) 00000100:00100000:2.0:1784756002.359133:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170098176:12345-192.168.204.21@tcp:101:ll_cfg_requeue.0 Request processed in 159us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.359140:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 169 00000100:00100000:1.0:1784756002.362449:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756002.362578:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170098304 00000100:00100000:0.0:1784756002.362589:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170098304 00000100:00100000:0.0:1784756002.362747:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 170 00000100:00100000:0.0:1784756002.362761:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170098304:12345-192.168.204.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756002.363190:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170098304:12345-192.168.204.21@tcp:501:ll_cfg_requeue.0 Request processed in 430us (754us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784756002.363198:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 170 00000100:00100000:0.0:1784756002.586278:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756002.586315:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190048000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756002.586388:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756002.586476:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190048000 00000100:00100000:0.0:1784756002.586483:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190048000 00000100:00100000:0.0:1784756002.586546:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784756002.586555:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190048000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756002.586594:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756002.586652:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190048000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756002.586659:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1784756002.586714:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1ae1ee680 x1871452190048000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756002.586734:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190048000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756002.826215:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756002.826293:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756002.826305:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170098432 00000100:00100000:2.0:1784756002.826320:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170098432 00000100:00100000:2.0:1784756002.826396:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 171 00000100:00100000:2.0:1784756002.826409:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170098432:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756002.826508:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170098432:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 101us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.826517:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 171 00000100:00100000:3.0:1784756002.826796:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170098560 00000100:00100000:3.0:1784756002.826802:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170098560 00000100:00100000:3.0:1784756002.826905:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 28 00000100:00100000:3.0:1784756002.826914:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170098560:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756002.826961:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170098560:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 48us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756002.826968:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 28 00000100:00080000:2.0:1784756002.827187:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756002.838237:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756002.838281:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756002.838375:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170098816 00000100:00100000:2.0:1784756002.838385:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170098816 00000100:00100000:2.0:1784756002.838455:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170098688 00000100:00100000:2.0:1784756002.838458:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170098688 00000100:00100000:2.0:1784756002.838477:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 15 00000100:00100000:2.0:1784756002.838497:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+5:2349:x1871452170098816:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756002.838584:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+5:2349:x1871452170098816:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 88us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.838591:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 15 00000100:00100000:2.0:1784756002.838609:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 16 00000100:00100000:2.0:1784756002.838615:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+5:2349:x1871452170098688:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756002.838641:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+5:2349:x1871452170098688:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756002.838647:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 16 00000100:00080000:3.0:1784756002.839945:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784756002.839955:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784756003.097004:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784756003.464090:0:8360:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9fd130c0 20000000:00000080:3.0:1784756003.464109:0:8360:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96f182d7b400 uarg=0000000000000000 20000000:01000000:3.0:1784756003.464143:0:8360:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784756003.464154:0:8360:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784756003.464159:0:8360:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784756003.470262:0:8361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1784756003.470386:0:8360:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1784756003.477649:0:8360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1784756003.477721:0:8360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1784756003.477781:0:8360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1784756003.477799:0:8360:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784756003.477818:0:8360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.477869:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f180030600/0xbe94f39231c84d5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84d53 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.477877:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f1c21dda00/0xbe94f39231c84dd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84dca expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.477896:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84e33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84e2c expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.477906:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f185038e00/0xbe94f39231c84ef0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cbc expref: 9 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.477914:0:8360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.477957:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f185038e00/0xbe94f39231c84ef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cbc expref: 9 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.477972:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96f185038e00/0xbe94f39231c84ef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cbc expref: 9 pid: 5774 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756003.477990:0:8360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1871452190048128:192.168.204.21@tcp:104: 00010000:00010000:0.0:1784756003.478386:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84e2c expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.478395:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84e33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84e2c expref: 18 pid: 5777 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756003.478405:0:8360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1871452190048256:0@lo:104: 00000100:00100000:0.0:1784756003.478444:0:8360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784756003.478482:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f1c21dda00/0xbe94f39231c84dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84dca expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.478490:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96f1c21dda00/0xbe94f39231c84dd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84dca expref: 18 pid: 5774 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756003.478511:0:8360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1871452190048384:0@lo:104: 00000100:00100000:0.0:1784756003.478537:0:8360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756003.478577:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784756003.478589:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190048256 00000100:00100000:0.0:1784756003.478596:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190048256 00000100:00100000:0.0:1784756003.478633:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190048384 00000100:00100000:0.0:1784756003.478636:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190048384 00000100:00100000:0.0:1784756003.478650:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784756003.478658:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+4:8360:x1871452190048256:12345-0@lo:104: 00010000:00010000:0.0:1784756003.478682:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.478726:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784756003.478732:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+4:8360:x1871452190048256:12345-0@lo:104: Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756003.478738:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784756003.478763:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784756003.478771:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc467850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:8360:x1871452190048384:12345-0@lo:104: 00010000:00010000:0.0:1784756003.478778:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.478801:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784756003.478811:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784756003.478817:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc467850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:8360:x1871452190048384:12345-0@lo:104: Request processed in 48us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756003.478821:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1784756003.479995:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.480116:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181500a00 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:2.0:1784756003.480133:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.480143:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756003.480151:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756003.480156:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784756003.480241:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.480247:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756003.480271:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.480278:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f181500a00/0xbe94f39231c84e2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84e33 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.480293:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784756003.480296:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.480302:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181500800 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:2.0:1784756003.480305:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.480312:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756003.480330:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756003.480335:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1784756003.480445:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190048512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784756003.480495:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756003.480566:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190048512 00000100:00100000:3.0:1784756003.480573:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190048512 00010000:00010000:3.0:1784756003.480599:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84e33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e2c expref: 19 pid: 5777 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756003.480627:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784756003.480634:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190048512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784756003.480646:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756003.480652:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84e33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84e2c expref: 19 pid: 5777 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.480661:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84e33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84e2c expref: 19 pid: 5777 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.480690:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756003.480725:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190048512:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.480731:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784756003.480768:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190048512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784756003.480909:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f180030600/0xbe94f39231c84d5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84d53 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.480920:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96f180030600/0xbe94f39231c84d5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84d53 expref: 18 pid: 5776 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756003.480941:0:8360:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1871452190048640:0@lo:104: 00000100:00100000:3.0:1784756003.480967:0:8360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756003.480986:0:8360:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1909ec000 going to sleep for 11 seconds 00010000:00010000:3.0:1784756003.481000:0:8360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f1c21de000/0xbe94f39231c84e33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84e2c expref: 18 pid: 5777 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756003.481023:0:8360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1871452190048256:0@lo:104: 00000100:00100000:3.0:1784756003.481034:0:8360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1871452190048384:0@lo:104: 00010000:00010000:2.0:1784756003.481215:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.481223:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756003.481237:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.481243:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f181500800/0xbe94f39231c84dca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84dd8 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.481253:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756003.481255:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756003.481256:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756003.481266:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190048768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784756003.482162:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756003.482239:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190048768 00000100:00100000:2.0:1784756003.482244:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190048768 00010000:00010000:2.0:1784756003.482266:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f1c21dda00/0xbe94f39231c84dd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84dca expref: 18 pid: 5774 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756003.482291:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784756003.482297:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+18:3301:x1871452190048768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784756003.482380:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756003.482387:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f1c21dda00/0xbe94f39231c84dd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84dca expref: 18 pid: 5774 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.482404:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f1c21dda00/0xbe94f39231c84dd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84dca expref: 18 pid: 5774 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.482416:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f1c21dda00/0xbe94f39231c84dd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84dca expref: 18 pid: 5774 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.482428:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756003.482461:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9117e42-6e26-4b4a-b619-3540b762413c+17:3301:x1871452190048768:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.482467:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784756003.482505:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190048768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784756003.482545:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190048640 00000100:00100000:2.0:1784756003.482549:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190048640 00000100:00100000:2.0:1784756003.482573:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784756003.482580:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:8360:x1871452190048640:12345-0@lo:104: 00010000:00010000:2.0:1784756003.482591:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f1c21dea00/0xbe94f39231c84d53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.482788:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784756003.482794:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:8360:x1871452190048640:12345-0@lo:104: Request processed in 215us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.482801:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1784756003.482819:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784756003.482825:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f1c21dea00/0xbe94f39231c84d53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.482855:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21dea00 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:2.0:1784756003.482865:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dea00/0xbe94f39231c84d53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.482873:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f1c21dea00/0xbe94f39231c84d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784756003.482879:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f1c21dea00/0xbe94f39231c84d53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756003.482883:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784756003.482903:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f1c21dea00/0xbe94f39231c84d53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.482909:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784756003.482927:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dea00/0xbe94f39231c84d53 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.482933:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f1c21dea00/0xbe94f39231c84d53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84d5a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.482959:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756003.482961:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756003.482974:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756003.482987:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190048896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784756003.483015:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756003.483177:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190048896 00000100:00100000:2.0:1784756003.483182:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190048896 00010000:00010000:2.0:1784756003.483199:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f180030600/0xbe94f39231c84d5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84d53 expref: 17 pid: 5776 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756003.483222:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784756003.483236:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+17:3302:x1871452190048896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784756003.483246:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756003.483251:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f180030600/0xbe94f39231c84d5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84d53 expref: 17 pid: 5776 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.483261:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f180030600/0xbe94f39231c84d5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84d53 expref: 17 pid: 5776 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.483272:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756003.483301:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9117e42-6e26-4b4a-b619-3540b762413c+17:3302:x1871452190048896:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.483385:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784756003.483421:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f9117e42-6e26-4b4a-b619-3540b762413c:3302:1871452190048896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784756003.483553:0:8360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f180030600/0xbe94f39231c84d5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84d53 expref: 16 pid: 5776 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756003.484176:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756003.484563:0:8360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1871452190048640:0@lo:104: 00000100:00100000:0.0:1784756003.489321:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756003.489468:0:8360:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1871452190048128:192.168.204.21@tcp:104: 00010000:00010000:3.0:1784756003.489508:0:8360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756003.489992:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170098944 00000100:00100000:2.0:1784756003.490001:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170098944 00010000:00010000:2.0:1784756003.490036:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f185038e00/0xbe94f39231c84ef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cbc expref: 10 pid: 5774 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756003.490113:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 24 00000100:00100000:2.0:1784756003.490128:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170098944:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784756003.490143:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756003.490149:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f185038e00/0xbe94f39231c84ef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cbc expref: 10 pid: 5774 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490161:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f185038e00/0xbe94f39231c84ef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cbc expref: 10 pid: 5774 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490180:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f185038e00/0xbe94f39231c84ef0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cbc expref: 10 pid: 5774 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490219:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490227:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490242:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490249:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490256:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490263:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490269:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aac200 already unused, calling callback (ffffffffc1436230) 00010000:00010000:2.0:1784756003.490273:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490280:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490306:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756003.490329:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784756003.490418:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:994158a7-52a9-48df-b40e-50a3e29f70de+9:2348:x1871452170098944:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 295us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.490431:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 24 00010000:00010000:3.0:1784756003.490546:0:8360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.490556:0:8360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756003.490563:0:8360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f186aac200/0xbe94f39231c84f91 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756003.730417:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756003.730455:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170099072 00000100:00100000:1.0:1784756003.730465:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170099072 00000100:00100000:1.0:1784756003.730512:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 172 00000100:00100000:1.0:1784756003.730530:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+9:5561:x1871452170099072:12345-192.168.204.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756003.730547:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756003.730566:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f185038c00/0xbe94f39231c84f98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1cfb expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.730591:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f185038c00/0xbe94f39231c84f98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cfb expref: 10 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.730601:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f185038c00/0xbe94f39231c84f98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cfb expref: 10 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756003.730609:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185038c00, rc 0) 00000100:00100000:1.0:1784756003.730659:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170099072:12345-192.168.204.21@tcp:101:ll_cfg_requeue.0 Request processed in 131us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756003.730666:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 172 00000100:00100000:2.0:1784756003.751043:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756003.751133:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170099200 00000100:00100000:0.0:1784756003.751141:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170099200 00000100:00100000:0.0:1784756003.751201:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 173 00000100:00100000:0.0:1784756003.751211:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170099200:12345-192.168.204.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756003.751515:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170099200:12345-192.168.204.21@tcp:501:ll_cfg_requeue.0 Request processed in 305us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756003.751523:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 173 00000100:00100000:1.0:1784756003.755607:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756003.755726:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170099328 00000100:00100000:2.0:1784756003.755737:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170099328 00000100:00100000:2.0:1784756003.755798:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 174 00000100:00100000:2.0:1784756003.755808:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170099328:12345-192.168.204.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756003.757156:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170099328:12345-192.168.204.21@tcp:503:ll_cfg_requeue.0 Request processed in 1343us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756003.757168:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 174 00000100:00100000:2.0:1784756003.766629:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756003.766712:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170099456 00000100:00100000:3.0:1784756003.766722:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170099456 00000100:00100000:3.0:1784756003.766781:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 175 00000100:00100000:3.0:1784756003.766805:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:6096:x1871452170099456:12345-192.168.204.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784756003.767073:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:6096:x1871452170099456:12345-192.168.204.21@tcp:502:llog_process_th.0 Request processed in 270us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.767080:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 175 00000100:00100000:1.0:1784756003.790306:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756003.791556:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170099584 00000100:00100000:3.0:1784756003.791568:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170099584 00000100:00100000:3.0:1784756003.791631:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 176 00000100:00100000:3.0:1784756003.791642:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:6096:x1871452170099584:12345-192.168.204.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784756003.791922:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:6096:x1871452170099584:12345-192.168.204.21@tcp:502:llog_process_th.0 Request processed in 280us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756003.791931:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 176 00010000:00010000:2.0:1784756004.122149:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756005.147818:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784756005.211869:0:5779:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784756005.211878:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96f1abd8c000 from 4 10000000:01000000:2.0:1784756005.211882:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784756005.211931:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.211943:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.211955:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756005.211983:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756005.212059:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756005.212115:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f190f5d240 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.212209:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190049024 00000100:00100000:0.0:1784756005.212217:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190049024 00000100:00100000:0.0:1784756005.212278:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1784756005.212289:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190049024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756005.212302:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756005.212315:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f186aac800/0xbe94f39231c84fa6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84f9f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.212339:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f186aac800/0xbe94f39231c84fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84f9f expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.212350:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f186aac800/0xbe94f39231c84fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84f9f expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.212359:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aac800, rc 0) 00000100:00100000:0.0:1784756005.212401:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190049024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.212408:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1784756005.214864:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756005.214927:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.214940:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756005.215033:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756005.215103:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756005.215152:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186032600 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.215187:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190049152 00000100:00100000:0.0:1784756005.215194:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190049152 00000100:00100000:0.0:1784756005.215241:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784756005.215250:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190049152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756005.221367:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190049152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6108us (6254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.221383:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784756005.221512:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1edf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756005.221589:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756005.221638:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756005.221700:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f190f5d600 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.221869:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190049280 00000100:00100000:0.0:1784756005.221876:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190049280 00000100:00100000:0.0:1784756005.221915:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784756005.221924:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190049280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756005.222100:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190049280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.222107:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1784756005.223267:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784756005.228089:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8422:1871452190049408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756005.228168:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756005.228217:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e600 going to sleep for 11 seconds 00000100:00100000:2.0:1784756005.228591:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190049408 00000100:00100000:2.0:1784756005.228599:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190049408 00000100:00100000:2.0:1784756005.228662:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1784756005.228673:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:8422:x1871452190049408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756005.228934:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:8422:x1871452190049408:12345-0@lo:502:llog_process_th.0 Request processed in 263us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756005.228942:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784756005.229114:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8422:1871452190049408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784756005.229146:0:8422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784756005.229155:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756005.229158:0:8422:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784756005.229164:0:8422:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96f1abd8c000 00000020:00000080:1.0:1784756005.229172:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784756005.229258:0:8422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8422:1871452190049536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756005.229293:0:8422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756005.229319:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190049536 00000100:00100000:1.0:1784756005.229323:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190049536 00000100:00100000:1.0:1784756005.229347:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784756005.229353:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+17:8422:x1871452190049536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756005.229548:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+17:8422:x1871452190049536:12345-0@lo:502:llog_process_th.0 Request processed in 195us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756005.229555:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784756005.229674:0:8422:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f18604e600 going to sleep for 11 seconds 00000100:00100000:1.0:1784756005.229687:0:8422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8422:1871452190049536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784756005.229705:0:8422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784756005.229709:0:8422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784756005.229711:0:8422:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784756005.229715:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784756005.235015:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784756005.235059:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784756005.235071:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.235083:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756005.235093:0:5779:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784756005.235096:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96f1bc39f800 from 4 10000000:01000000:2.0:1784756005.235098:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784756005.235135:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.235143:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.235153:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756005.235186:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756005.235254:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756005.235306:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f190f5d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784756005.235327:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190049664 00000100:00100000:2.0:1784756005.235334:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190049664 00000100:00100000:2.0:1784756005.235383:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1784756005.235391:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190049664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756005.235405:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756005.235419:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f180030600/0xbe94f39231c84fb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84fad expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.235440:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f180030600/0xbe94f39231c84fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84fad expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.235451:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f180030600/0xbe94f39231c84fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84fad expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.237373:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f180030600, rc 0) 00000100:00100000:2.0:1784756005.237468:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190049664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2062us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756005.237477:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1784756005.237547:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756005.237569:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756005.237581:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756005.239015:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756005.239071:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756005.239118:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f190f5d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.240624:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190049792 00000100:00100000:0.0:1784756005.240637:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190049792 00000100:00100000:0.0:1784756005.240698:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1784756005.240706:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190049792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756005.241023:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190049792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 316us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.241031:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1784756005.241095:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756005.241145:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756005.241185:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756005.241213:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186032e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.241225:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190049920 00000100:00100000:0.0:1784756005.241229:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190049920 00000100:00100000:0.0:1784756005.241249:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784756005.241255:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f18508b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190049920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756005.241387:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f18508b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190049920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.241393:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784756005.241431:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190049920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756005.249883:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8425:1871452190050048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756005.249971:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756005.250012:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f190f5d600 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.250817:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190050048 00000100:00100000:0.0:1784756005.250827:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190050048 00000100:00100000:0.0:1784756005.250892:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1784756005.250903:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:8425:x1871452190050048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756005.252730:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:8425:x1871452190050048:12345-0@lo:502:llog_process_th.0 Request processed in 1820us (2750us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.252745:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1784756005.257479:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8425:1871452190050048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756005.257523:0:8425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784756005.257533:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756005.257536:0:8425:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784756005.257542:0:8425:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96f1bc39f800 00000020:00000080:2.0:1784756005.257546:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784756005.258013:0:8425:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8425:1871452190050176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784756005.258090:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756005.258134:0:8425:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f190f5d600 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.261185:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190050176 00000100:00100000:0.0:1784756005.261202:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190050176 00000100:00100000:0.0:1784756005.261267:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1784756005.261289:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+18:8425:x1871452190050176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756005.261574:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+18:8425:x1871452190050176:12345-0@lo:502:llog_process_th.0 Request processed in 287us (3484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.261582:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1784756005.291302:0:8425:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8425:1871452190050176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784756005.291400:0:8425:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784756005.291409:0:8425:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784756005.291411:0:8425:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784756005.291416:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784756005.291953:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1784756005.291972:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784756005.291983:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.291995:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756005.292005:0:5779:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784756005.292008:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96f18794d800 from 4 10000000:01000000:0.0:1784756005.292011:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784756005.292042:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.292599:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.292611:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756005.292648:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190050304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784756005.292716:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756005.292757:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186032a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.292781:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190050304 00000100:00100000:0.0:1784756005.292788:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190050304 00000100:00100000:0.0:1784756005.292874:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1784756005.292884:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f18508b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190050304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756005.292897:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756005.292911:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f186aacc00/0xbe94f39231c84fc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84fbb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.292937:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f186aacc00/0xbe94f39231c84fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84fbb expref: 19 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.292949:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f186aacc00/0xbe94f39231c84fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84fbb expref: 19 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.292958:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aacc00, rc 0) 00000100:00100000:0.0:1784756005.292997:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f18508b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190050304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.293004:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1784756005.293068:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190050304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756005.293083:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756005.293092:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756005.293137:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190050432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756005.293162:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756005.293180:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186032a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.293192:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190050432 00000100:00100000:0.0:1784756005.293195:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190050432 00000100:00100000:0.0:1784756005.293224:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1784756005.293231:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190050432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756005.295427:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185088450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190050432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2180us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.295441:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1784756005.303577:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1edc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190050432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756005.303665:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190050560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756005.303744:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756005.303787:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f190f5d600 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.304180:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190050560 00000100:00100000:0.0:1784756005.304188:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190050560 00000100:00100000:0.0:1784756005.304233:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1784756005.304244:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f18508b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190050560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756005.304423:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f18508b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190050560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756005.304431:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1784756005.307714:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190050560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756005.312790:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8428:1871452190050688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784756005.312909:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.312946:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1c0d78600 going to sleep for 11 seconds 00000100:00100000:1.0:1784756005.313271:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190050688 00000100:00100000:1.0:1784756005.313279:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190050688 00000100:00100000:1.0:1784756005.313497:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1784756005.313507:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:8428:x1871452190050688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784756005.313814:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:8428:x1871452190050688:12345-0@lo:502:llog_process_th.0 Request processed in 307us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756005.313821:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1784756005.314332:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8428:1871452190050688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784756005.314363:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784756005.314373:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756005.314375:0:8428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784756005.314382:0:8428:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96f18794d800 00000020:00000080:3.0:1784756005.314385:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784756005.314468:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8428:1871452190050816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784756005.314512:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756005.314538:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1c0d78600 going to sleep for 11 seconds 00000100:00100000:0.0:1784756005.318433:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190050816 00000100:00100000:0.0:1784756005.318448:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190050816 00000100:00100000:0.0:1784756005.318713:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1784756005.318724:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:8428:x1871452190050816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784756005.319545:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185089450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:8428:x1871452190050816:12345-0@lo:502:llog_process_th.0 Request processed in 821us (5030us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756005.319631:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f9117e42-6e26-4b4a-b619-3540b762413c:8428:1871452190050816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784756005.319681:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784756005.319694:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784756005.319696:0:8428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784756005.319701:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:0.0:1784756005.320001:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000020:01000000:3.0:1784756005.320117:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784756005.320138:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784756005.320147:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756005.320159:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756006.170899:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190050944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756006.170979:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756006.171090:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190050944 00000100:00100000:1.0:1784756006.171099:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190050944 00000100:00100000:1.0:1784756006.171158:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784756006.171168:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190050944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756006.171216:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756006.171260:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190050944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756006.171278:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1784756006.171434:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756006.171479:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53d8a80 x1871452190050944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756006.171512:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190050944:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784756006.174097:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756007.197081:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756007.197270:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190051072:0@lo:400:kworker.0 00000100:00100000:1.0:1784756007.197355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756007.197416:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190051584:0@lo:400:kworker.0 00000100:00100000:1.0:1784756007.197464:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756007.197494:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784756007.197501:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190051200:0@lo:400:kworker.0 00000100:00100000:1.0:1784756007.197524:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756007.197544:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190051712:0@lo:400:kworker.0 00000100:00100000:1.0:1784756007.197569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756007.197615:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190051328:0@lo:400:kworker.0 00000100:00100000:1.0:1784756007.197638:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756007.197659:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756007.197665:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190051456:0@lo:400:kworker.0 00000100:00100000:1.0:1784756007.197687:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756007.197723:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190051072 00000100:00100000:1.0:1784756007.197730:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190051072 00000100:00100000:1.0:1784756007.197777:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1784756007.197785:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190051072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756007.197850:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190051072:12345-0@lo:400:kworker.0 Request processed in 49us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756007.197864:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1784756007.197895:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190051584 00000100:00100000:1.0:1784756007.197898:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190051584 00000100:00100000:1.0:1784756007.197926:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190051200 00000100:00100000:1.0:1784756007.197929:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190051200 00000100:00100000:1.0:1784756007.197938:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190051328 00000100:00100000:1.0:1784756007.197940:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190051328 00000100:00100000:1.0:1784756007.197952:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784756007.197957:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190051584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756007.197986:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190051584:12345-0@lo:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756007.197992:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784756007.198002:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784756007.198007:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190051200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756007.198032:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190051200:12345-0@lo:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756007.198037:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784756007.202620:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190051712 00000100:00100000:3.0:1784756007.202640:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190051712 00000100:00100000:3.0:1784756007.202720:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190051456 00000100:00100000:3.0:1784756007.202724:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190051456 00000100:00100000:3.0:1784756007.202749:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784756007.202760:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190051712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756007.203157:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190051712:12345-0@lo:400:kworker.0 Request processed in 394us (5582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756007.203160:0:6581:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784756007.203170:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784756007.203179:0:6581:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1784756007.203203:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784756007.203215:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190051456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756007.203270:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190051456:12345-0@lo:400:kworker.0 Request processed in 59us (5581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756007.203277:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784756007.203303:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784756007.203313:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190051328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756007.203350:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190051328:12345-0@lo:400:kworker.0 Request processed in 40us (5711us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756007.203370:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1784756007.203431:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756007.203436:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756007.203489:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190051200:0@lo:400:kworker.0 00010000:00080000:3.0:1784756007.203512:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53d8a80 x1871452190051712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756007.203525:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190051712:0@lo:400:kworker.0 00000100:00100000:3.0:1784756007.203540:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190051072:0@lo:400:kworker.0 00000100:00100000:3.0:1784756007.203553:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190051584:0@lo:400:kworker.0 00010000:00080000:3.0:1784756007.205692:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53d9180 x1871452190051456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756007.205714:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190051456:0@lo:400:kworker.0 00000100:00100000:3.0:1784756007.205733:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190051328:0@lo:400:kworker.0 00000100:00100000:1.0:1784756007.713051:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784756007.713077:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190051840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756007.713155:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756007.713523:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190051840 00000100:00100000:1.0:1784756007.713531:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190051840 00000100:00100000:1.0:1784756007.715815:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784756007.715853:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190051840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756007.715895:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756007.715976:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190051840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756007.715993:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1784756007.716172:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1861a1880 x1871452190051840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756007.716192:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190051840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756007.958802:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756007.958867:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756007.958896:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756007.958923:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170099840 00000100:00100000:0.0:1784756007.958933:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170099840 00000100:00100000:0.0:1784756007.959002:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 32 00000100:00100000:0.0:1784756007.959013:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170099840:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1784756007.959090:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170099840:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 78us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756007.959097:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 32 00000100:00080000:0.0:1784756007.959126:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756007.959159:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756007.959183:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170099968 00000100:00100000:0.0:1784756007.959187:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170099968 00000100:00100000:0.0:1784756007.959214:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170100096 00000100:00100000:0.0:1784756007.959217:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170100096 00000100:00100000:0.0:1784756007.959405:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 19 00000100:00100000:0.0:1784756007.959415:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+5:2348:x1871452170099968:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1784756007.959442:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+5:2348:x1871452170099968:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 30us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756007.959459:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 19 00000100:00100000:0.0:1784756007.959474:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 20 00000100:00100000:0.0:1784756007.959479:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+5:2348:x1871452170100096:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1784756007.959511:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+5:2348:x1871452170100096:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 31us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756007.959516:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 20 00000100:00080000:0.0:1784756007.959532:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784756007.959535:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784756007.963902:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170099712 00000100:00100000:1.0:1784756007.963917:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170099712 00000100:00100000:1.0:1784756007.963991:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 193 00000100:00100000:1.0:1784756007.964002:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170099712:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756007.964080:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170099712:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 80us (5286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756007.964088:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 193 00010000:00010000:1.0:1784756008.217827:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756009.242006:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756010.264999:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756010.374116:0:8663:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg421-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1784756011.292962:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190051968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756011.293077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756011.293143:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190051968 00000100:00100000:1.0:1784756011.293150:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190051968 00000100:00100000:1.0:1784756011.293195:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784756011.293203:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190051968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756011.293749:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756011.293857:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190051968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 653us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756011.293867:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1784756011.293889:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784756011.294779:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1784756011.294999:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1861a0e00 x1871452190051968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756011.295025:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190051968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756012.313401:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190052096:0@lo:400:kworker.0 00000100:00100000:3.0:1784756012.313488:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756012.313545:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190052608:0@lo:400:kworker.0 00000100:00100000:3.0:1784756012.313570:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756012.313608:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784756012.313628:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190052224:0@lo:400:kworker.0 00000100:00100000:3.0:1784756012.313651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756012.313667:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190052736:0@lo:400:kworker.0 00000100:00100000:3.0:1784756012.313692:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756012.313714:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190052480:0@lo:400:kworker.0 00000100:00100000:3.0:1784756012.313757:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756012.313779:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784756012.313784:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190052352:0@lo:400:kworker.0 00000100:00100000:2.0:1784756012.313784:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190052608 00000100:00100000:2.0:1784756012.313792:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190052608 00000100:00100000:3.0:1784756012.313804:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756012.313825:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190052224 00000100:00100000:3.0:1784756012.313829:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190052224 00000100:00100000:2.0:1784756012.313856:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190052352 00000100:00100000:2.0:1784756012.313859:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190052352 00000100:00100000:3.0:1784756012.313866:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1784756012.313909:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756012.313922:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190052736 00000100:00100000:0.0:1784756012.313926:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190052736 00000100:00100000:0.0:1784756012.313953:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190052480 00000100:00100000:0.0:1784756012.313956:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190052480 00000100:00100000:0.0:1784756012.313974:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784756012.313980:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190052736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756012.314032:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190052736:12345-0@lo:400:kworker.0 Request processed in 52us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756012.314040:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784756012.314063:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784756012.314069:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190052480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756012.314104:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190052480:12345-0@lo:400:kworker.0 Request processed in 36us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756012.314110:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784756012.314147:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190052608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756012.314183:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190052608:12345-0@lo:400:kworker.0 Request processed in 309us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756012.316208:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190052096 00000100:00100000:1.0:1784756012.316221:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190052096 00000100:00100000:1.0:1784756012.316267:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1784756012.316276:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190052096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756012.316366:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190052096:12345-0@lo:400:kworker.0 Request processed in 91us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756012.316374:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1784756012.316406:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784756012.316412:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756012.316589:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784756012.316598:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190052224:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1784756012.316799:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc581f80 x1871452190052736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756012.316813:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190052736:0@lo:400:kworker.0 00000100:00100000:2.0:1784756012.316978:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190052224:12345-0@lo:400:kworker.0 Request processed in 380us (3324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756012.316985:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784756012.317001:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784756012.317009:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190052352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756012.317038:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190052352:12345-0@lo:400:kworker.0 Request processed in 31us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756012.317043:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784756012.317446:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190052352:0@lo:400:kworker.0 00010000:00080000:0.0:1784756012.317556:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc580e00 x1871452190052480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756012.317568:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190052480:0@lo:400:kworker.0 00000100:00100000:1.0:1784756012.318157:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190052096:0@lo:400:kworker.0 00000100:00100000:1.0:1784756012.318173:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190052608:0@lo:400:kworker.0 00000100:00100000:1.0:1784756012.318199:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190052224:0@lo:400:kworker.0 00000100:00100000:3.0:1784756012.318395:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784756012.827245:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190052864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756012.827315:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756012.827990:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190052864 00000100:00100000:3.0:1784756012.827999:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190052864 00000100:00100000:3.0:1784756012.828056:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784756012.828066:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190052864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756012.828102:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756012.828155:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190052864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756012.828162:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1784756012.828216:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc581500 x1871452190052864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756012.828235:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190052864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756013.070593:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756013.070639:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756013.070709:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170100352 00000100:00100000:1.0:1784756013.070715:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170100224 00000100:00100000:2.0:1784756013.070719:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170100352 00000100:00100000:1.0:1784756013.070719:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170100224 00000100:00100000:1.0:1784756013.070768:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 195 00000100:00100000:2.0:1784756013.070770:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 36 00000100:00100000:2.0:1784756013.070777:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170100352:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756013.070777:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170100224:12345-192.168.204.21@tcp:400:kworker.0 00000100:00080000:3.0:1784756013.070886:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756013.070983:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170100224:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 84us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756013.070992:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 195 00000100:00100000:2.0:1784756013.078544:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170100352:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 7755us (7891us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756013.078560:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 36 00000100:00100000:3.0:1784756013.086710:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756013.086761:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756013.086854:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170100480 00000100:00100000:1.0:1784756013.086864:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170100480 00000100:00100000:1.0:1784756013.086930:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170100608 00000100:00100000:1.0:1784756013.086933:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170100608 00000100:00100000:1.0:1784756013.086958:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 10 00000100:00100000:1.0:1784756013.086967:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:633fb912-5a65-4a74-b46a-ec98078e3827+5:2346:x1871452170100480:12345-192.168.204.21@tcp:9:kworker.0 00000020:00000080:1.0:1784756013.087012:0:8479:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbe94f39231c84efe 00000100:00080000:1.0:1784756013.087022:0:8479:0:(import.c:65:import_set_state_nolock()) ffff96f1bc1ed000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784756013.087057:0:8479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1784756013.087384:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:633fb912-5a65-4a74-b46a-ec98078e3827+2:2346:x1871452170100480:12345-192.168.204.21@tcp:9:kworker.0 Request processed in 417us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756013.087393:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 10 00000100:00100000:1.0:1784756013.087410:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 11 00000100:00100000:1.0:1784756013.087416:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:633fb912-5a65-4a74-b46a-ec98078e3827+5:2346:x1871452170100608:12345-192.168.204.21@tcp:9:kworker.0 00000100:00080000:3.0:1784756013.087525:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784756013.087530:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784756013.087561:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784756013.087931:0:8479:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbe94f39231c84f05 00000100:00080000:1.0:1784756013.087939:0:8479:0:(import.c:65:import_set_state_nolock()) ffff96f1bc1ed800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784756013.087966:0:8479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1784756013.088177:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:633fb912-5a65-4a74-b46a-ec98078e3827+2:2346:x1871452170100608:12345-192.168.204.21@tcp:9:kworker.0 Request processed in 760us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756013.088184:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 11 00010000:00010000:3.0:1784756013.089025:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756013.338512:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756014.360921:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756015.387603:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756015.450923:0:8907:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg421-server.virtnet: executing yml_node 00010000:00010000:3.0:1784756016.409927:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756016.410014:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190052992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756016.410085:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756016.410192:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190052992 00000100:00100000:1.0:1784756016.410201:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190052992 00000100:00100000:1.0:1784756016.410273:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784756016.410284:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190052992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756016.410320:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1784756016.410350:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784756016.410367:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190052992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756016.410375:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1784756016.410413:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1861a1f80 x1871452190052992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756016.410442:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190052992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784756017.433385:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756017.433610:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190053120:0@lo:400:kworker.0 00000100:00100000:1.0:1784756017.433694:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756017.433746:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756017.433753:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190053248:0@lo:400:kworker.0 00000100:00100000:1.0:1784756017.433781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756017.433815:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190053120 00000100:00100000:1.0:1784756017.433823:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190053120 00000100:00100000:1.0:1784756017.433882:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1784756017.433891:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190053120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756017.433945:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190053120:12345-0@lo:400:kworker.0 Request processed in 54us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756017.433952:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1784756017.433982:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190053248 00000100:00100000:1.0:1784756017.433986:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190053248 00000100:00100000:2.0:1784756017.434861:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756017.434877:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190053376:0@lo:400:kworker.0 00000100:00100000:2.0:1784756017.434934:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756017.435024:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756017.435033:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190053504:0@lo:400:kworker.0 00000100:00100000:3.0:1784756017.435063:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756017.435109:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190053504 00000100:00100000:3.0:1784756017.435114:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190053504 00000100:00100000:3.0:1784756017.435158:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784756017.435166:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190053504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756017.435210:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190053504:12345-0@lo:400:kworker.0 Request processed in 45us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756017.435216:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784756017.435253:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190053760:0@lo:400:kworker.0 00000100:00100000:3.0:1784756017.435277:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756017.435317:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784756017.435324:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190053632:0@lo:400:kworker.0 00000100:00100000:3.0:1784756017.435352:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190053760 00000100:00100000:3.0:1784756017.435356:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190053760 00000100:00100000:3.0:1784756017.435391:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784756017.435397:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190053760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756017.435446:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190053760:12345-0@lo:400:kworker.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756017.435451:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1784756017.435467:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784756017.435493:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc583100 x1871452190053504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756017.435508:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190053504:0@lo:400:kworker.0 00000100:00100000:0.0:1784756017.437051:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190053120:0@lo:400:kworker.0 00000100:00100000:1.0:1784756017.441342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756017.441357:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190053376 00000100:00100000:0.0:1784756017.441376:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190053376 00000100:00100000:0.0:1784756017.441530:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784756017.441541:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190053248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756017.441645:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190053248:12345-0@lo:400:kworker.0 Request processed in 106us (7863us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756017.441652:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784756017.441671:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784756017.441677:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190053376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756017.441708:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190053376:12345-0@lo:400:kworker.0 Request processed in 31us (6773us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756017.441714:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784756017.441762:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190053248:0@lo:400:kworker.0 00000100:00080000:0.0:1784756017.441955:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756017.442031:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190053376:0@lo:400:kworker.0 00010000:00080000:1.0:1784756017.451172:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc580e00 x1871452190053760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756017.451191:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190053760:0@lo:400:kworker.0 00000100:00100000:0.0:1784756017.452296:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190053632 00000100:00100000:0.0:1784756017.452307:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190053632 00000100:00100000:0.0:1784756017.452372:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784756017.452382:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190053632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756017.452476:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190053632:12345-0@lo:400:kworker.0 Request processed in 95us (11261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756017.452495:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784756017.455201:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190053632:0@lo:400:kworker.0 00000100:00080000:0.0:1784756017.456167:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1784756017.488490:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 633fb912-5a65-4a74-b46a-ec98078e3827 00000020:00000080:1.0:1784756017.488500:0:7497:0:(genops.c:906:class_export_put()) final put ffff96f1bc1eb000/633fb912-5a65-4a74-b46a-ec98078e3827 00000020:00000080:3.0:1784756017.488602:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96f1bc1eb000/633fb912-5a65-4a74-b46a-ec98078e3827 for lustre-OST0001 00000020:00000080:3.0:1784756017.488667:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96f1bc1ed800 for lustre-OST0001 00000100:00100000:3.0:1784756017.947184:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190053888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756017.947263:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756017.947346:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190053888 00000100:00100000:3.0:1784756017.947354:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190053888 00000100:00100000:3.0:1784756017.947425:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784756017.947438:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190053888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756017.947475:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756017.947519:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190053888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756017.947526:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1784756017.947555:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1861a2300 x1871452190053888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756017.947574:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190053888:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1784756018.000055:0:6606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 633fb912-5a65-4a74-b46a-ec98078e3827 00000020:00000080:3.0:1784756018.000282:0:6606:0:(genops.c:906:class_export_put()) final put ffff96f1bc1ef800/633fb912-5a65-4a74-b46a-ec98078e3827 00000020:00000080:2.0:1784756018.000353:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff96f1bc1ef800/633fb912-5a65-4a74-b46a-ec98078e3827 for lustre-OST0000 00000020:00000080:2.0:1784756018.000410:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96f1bc1ed000 for lustre-OST0000 00000100:00100000:3.0:1784756018.188089:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756018.188134:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756018.188475:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170100736 00000100:00100000:1.0:1784756018.188486:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170100736 00000100:00100000:1.0:1784756018.188552:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 197 00000100:00100000:1.0:1784756018.188564:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170100736:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756018.188661:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170100736:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 99us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756018.188669:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 197 00000100:00100000:0.0:1784756018.188765:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170100864 00000100:00100000:0.0:1784756018.188771:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170100864 00000100:00100000:0.0:1784756018.188828:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 40 00000100:00100000:0.0:1784756018.188865:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170100864:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1784756018.188909:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170100864:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 47us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756018.188916:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 40 00000100:00080000:1.0:1784756018.189172:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784756018.457007:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756019.482341:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756019.632988:0:9100:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.183 00010000:00010000:2.0:1784756020.510128:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756021.528984:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756021.529006:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190054016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756021.529074:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784756021.529133:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756021.529233:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190054016 00000100:00100000:2.0:1784756021.529241:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190054016 00000100:00100000:2.0:1784756021.529309:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784756021.529320:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190054016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756021.529368:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756021.529420:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190054016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756021.529428:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1784756021.529823:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784756021.529889:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1861a1180 x1871452190054016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756021.529909:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190054016:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1784756022.161277:0:9197:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.183 00010000:00010000:2.0:1784756022.553920:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756022.554320:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190054272:0@lo:400:kworker.0 00000100:00100000:2.0:1784756022.554323:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190054528:0@lo:400:kworker.0 00000100:00100000:0.0:1784756022.554720:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190054144:0@lo:400:kworker.0 00000100:00100000:2.0:1784756022.555802:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756022.555883:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756022.555893:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190054400:0@lo:400:kworker.0 00000100:00100000:2.0:1784756022.555924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756022.555957:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190054528 00000100:00100000:2.0:1784756022.555964:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190054528 00000100:00100000:2.0:1784756022.556011:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784756022.556021:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190054528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756022.556075:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190054528:12345-0@lo:400:kworker.0 Request processed in 55us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756022.556096:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784756022.556121:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190054400 00000100:00100000:2.0:1784756022.556125:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190054400 00000100:00100000:2.0:1784756022.556161:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784756022.556168:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190054400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756022.556202:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190054400:12345-0@lo:400:kworker.0 Request processed in 36us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756022.556208:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784756022.556258:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190054400:0@lo:400:kworker.0 00010000:00080000:2.0:1784756022.556272:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1861a2680 x1871452190054528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756022.556282:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190054528:0@lo:400:kworker.0 00000100:00100000:0.0:1784756022.562627:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756022.562654:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784756022.562775:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756022.562785:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190054144 00000100:00100000:0.0:1784756022.562788:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190054656:0@lo:400:kworker.0 00000100:00100000:2.0:1784756022.562795:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190054144 00000100:00100000:1.0:1784756022.562797:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190054272 00000100:00100000:1.0:1784756022.562803:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190054272 00000100:00100000:2.0:1784756022.562905:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1784756022.562917:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190054144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756022.562982:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190054144:12345-0@lo:400:kworker.0 Request processed in 67us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756022.562990:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784756022.563075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756022.563123:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190054144:0@lo:400:kworker.0 00000100:00100000:2.0:1784756022.563542:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190054656 00000100:00100000:2.0:1784756022.563547:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190054656 00000100:00100000:2.0:1784756022.563593:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784756022.563600:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190054656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756022.563647:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190054656:12345-0@lo:400:kworker.0 Request processed in 47us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756022.563670:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784756022.563703:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190054656:0@lo:400:kworker.0 00000100:00080000:0.0:1784756022.563979:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756022.565039:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784756022.565053:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190054272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756022.565114:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190054272:12345-0@lo:400:kworker.0 Request processed in 66us (2461us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756022.565120:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784756022.565170:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190054272:0@lo:400:kworker.0 00000100:00100000:1.0:1784756022.565182:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190054784:0@lo:400:kworker.0 00000100:00100000:1.0:1784756022.565227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756022.565618:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190054784 00000100:00100000:0.0:1784756022.565625:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190054784 00000100:00100000:0.0:1784756022.565997:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784756022.566007:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190054784:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784756022.566132:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756022.566229:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190054784:12345-0@lo:400:kworker.0 Request processed in 225us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756022.566237:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1784756022.566776:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1861a2300 x1871452190054784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756022.566790:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190054784:0@lo:400:kworker.0 00000100:00100000:2.0:1784756023.065670:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190054912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756023.065745:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756023.066045:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190054912 00000100:00100000:3.0:1784756023.066053:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190054912 00000100:00100000:3.0:1784756023.066101:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784756023.066110:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190054912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756023.066688:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756023.066757:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190054912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 646us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756023.066765:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1784756023.067261:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc580e00 x1871452190054912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756023.067283:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190054912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756023.307462:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756023.307503:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756023.307532:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170100992 00000100:00100000:1.0:1784756023.307541:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170100992 00000100:00100000:1.0:1784756023.307591:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 199 00000100:00100000:1.0:1784756023.307602:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170100992:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756023.307684:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170100992:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756023.307692:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 199 00000100:00100000:1.0:1784756023.307726:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170101120 00000100:00100000:1.0:1784756023.307730:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170101120 00000100:00100000:1.0:1784756023.307770:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 44 00000100:00100000:1.0:1784756023.307777:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170101120:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756023.307807:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170101120:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756023.307814:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 44 00000100:00080000:1.0:1784756023.307941:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756023.577268:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756024.602995:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756024.912815:0:9294:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.183 00010000:00010000:1.0:1784756025.625398:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756026.650912:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756026.652251:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756026.652292:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190055040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756026.652408:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756026.652588:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190055040 00000100:00100000:2.0:1784756026.652598:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190055040 00000100:00100000:2.0:1784756026.652687:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784756026.652699:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190055040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756026.652749:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756026.652819:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190055040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756026.652827:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1784756026.654803:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1861a2d80 x1871452190055040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756026.654859:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190055040:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784756026.654976:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1784756026.742640:0:9343:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Wed Jul 22 17:33:44 EDT 2026 00000100:00100000:3.0:1784756027.673455:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190055168:0@lo:400:kworker.0 00000100:00100000:3.0:1784756027.673583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756027.674788:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756027.674811:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190055296:0@lo:400:kworker.0 00000100:00100000:3.0:1784756027.674910:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756027.674979:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190055168 00000100:00100000:3.0:1784756027.674990:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190055168 00000100:00100000:3.0:1784756027.675755:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1784756027.675773:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190055168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756027.675948:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190055168:12345-0@lo:400:kworker.0 Request processed in 180us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756027.675976:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1784756027.676620:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190055296 00000100:00100000:3.0:1784756027.676631:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190055296 00000100:00100000:3.0:1784756027.677230:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784756027.677242:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190055296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756027.677322:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190055296:12345-0@lo:400:kworker.0 Request processed in 83us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756027.677330:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:3.0:1784756027.677412:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756027.677460:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190055296:0@lo:400:kworker.0 00000100:00100000:3.0:1784756027.677474:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190055168:0@lo:400:kworker.0 00000100:00100000:1.0:1784756027.679867:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784756027.679906:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190055424:0@lo:400:kworker.0 00000100:00100000:1.0:1784756027.680007:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756027.680107:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190055424 00000100:00100000:1.0:1784756027.680117:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190055424 00000100:00100000:1.0:1784756027.680190:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784756027.680203:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190055424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756027.680277:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190055424:12345-0@lo:400:kworker.0 Request processed in 77us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756027.680285:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1784756027.680312:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756027.680354:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190055424:0@lo:400:kworker.0 00000100:00100000:1.0:1784756027.680418:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190055552:0@lo:400:kworker.0 00000100:00100000:1.0:1784756027.680452:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756027.681403:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784756027.681420:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190055680:0@lo:400:kworker.0 00000100:00100000:0.0:1784756027.681468:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756027.682100:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190055680 00000100:00100000:2.0:1784756027.682113:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190055680 00000100:00100000:2.0:1784756027.682368:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784756027.682383:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190055680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756027.682488:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190055680:12345-0@lo:400:kworker.0 Request processed in 109us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756027.682496:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784756027.682914:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190055552 00000100:00100000:1.0:1784756027.682921:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190055552 00000100:00100000:1.0:1784756027.682969:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784756027.682978:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190055552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756027.683032:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190055552:12345-0@lo:400:kworker.0 Request processed in 56us (2581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756027.683039:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1784756027.683063:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756027.683265:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190055680:0@lo:400:kworker.0 00000100:00100000:0.0:1784756027.683492:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190055808:0@lo:400:kworker.0 00010000:00080000:2.0:1784756027.683982:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1861a1180 x1871452190055552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756027.684016:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190055552:0@lo:400:kworker.0 00000100:00100000:0.0:1784756027.687574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756027.689368:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190055808 00000100:00100000:0.0:1784756027.689387:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190055808 00000100:00080000:3.0:1784756027.689457:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756027.689483:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784756027.689496:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190055808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756027.689707:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190055808:12345-0@lo:400:kworker.0 Request processed in 214us (2200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756027.689716:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1784756027.690226:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1ae1ef800 x1871452190055808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756027.690246:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190055808:0@lo:400:kworker.0 00000100:00100000:2.0:1784756028.185583:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190055936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756028.187954:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756028.188036:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190055936 00000100:00100000:0.0:1784756028.188046:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190055936 00000100:00100000:0.0:1784756028.188103:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784756028.188114:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190055936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756028.188154:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756028.188228:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190055936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756028.188250:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1784756028.188295:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1ae1ef800 x1871452190055936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756028.188315:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190055936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756028.421218:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756028.421278:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756028.423721:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170101248 00000100:00100000:2.0:1784756028.423733:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170101248 00000100:00100000:2.0:1784756028.423818:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 201 00000100:00100000:2.0:1784756028.423828:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170101248:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756028.423960:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170101248:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 132us (2681us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756028.423984:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 201 00000100:00100000:1.0:1784756028.424233:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170101376 00000100:00100000:1.0:1784756028.424238:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170101376 00000100:00100000:1.0:1784756028.424289:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 48 00000100:00100000:1.0:1784756028.424297:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2347:x1871452170101376:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756028.424329:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2347:x1871452170101376:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 33us (3129us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756028.424336:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 48 00000100:00080000:2.0:1784756028.424619:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756028.700012:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756029.720991:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756030.745111:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756031.769079:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756031.769162:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190056064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756031.769240:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756031.769389:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190056064 00000100:00100000:0.0:1784756031.769397:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190056064 00000100:00100000:0.0:1784756031.769470:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784756031.769481:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190056064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756031.769521:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756031.769571:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190056064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756031.769579:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1784756031.769663:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784756031.770590:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1861a1180 x1871452190056064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756031.770615:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190056064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784756032.793567:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756032.794365:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190056448:0@lo:400:kworker.0 00000100:00100000:1.0:1784756032.794434:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756032.794492:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756032.794498:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190056576:0@lo:400:kworker.0 00000100:00100000:1.0:1784756032.798776:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756032.798862:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190056576 00000100:00100000:1.0:1784756032.798871:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190056576 00000100:00100000:1.0:1784756032.798924:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784756032.798934:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190056576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756032.798995:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190056576:12345-0@lo:400:kworker.0 Request processed in 62us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756032.799003:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1784756032.799048:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b4d6f100 x1871452190056576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756032.799063:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190056576:0@lo:400:kworker.0 00000100:00100000:2.0:1784756032.799420:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190056448 00000100:00100000:2.0:1784756032.799425:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190056448 00000100:00100000:2.0:1784756032.799465:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784756032.799472:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190056448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756032.799524:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190056448:12345-0@lo:400:kworker.0 Request processed in 53us (5090us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756032.799531:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1784756032.799564:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756032.799589:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190056448:0@lo:400:kworker.0 00000100:00100000:2.0:1784756032.799630:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190056320:0@lo:400:kworker.0 00000100:00100000:2.0:1784756032.799678:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756032.799706:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190056832:0@lo:400:kworker.0 00000100:00100000:2.0:1784756032.799741:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756032.799770:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784756032.799777:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1861a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190056192:0@lo:400:kworker.0 00000100:00100000:2.0:1784756032.799801:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756032.799822:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190056704:0@lo:400:kworker.0 00000100:00100000:2.0:1784756032.799864:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756032.799887:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190056832 00000100:00100000:2.0:1784756032.799891:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190056832 00000100:00100000:2.0:1784756032.799920:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784756032.799926:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190056832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756032.799960:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190056832:12345-0@lo:400:kworker.0 Request processed in 34us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756032.799966:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784756032.799982:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190056192 00000100:00100000:2.0:1784756032.799985:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190056192 00000100:00100000:2.0:1784756032.800006:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1784756032.800012:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190056192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756032.800039:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190056192:12345-0@lo:400:kworker.0 Request processed in 27us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756032.800053:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:2.0:1784756032.800083:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756032.800108:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190056192:0@lo:400:kworker.0 00010000:00080000:2.0:1784756032.800137:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b4d6d880 x1871452190056832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756032.800147:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190056832:0@lo:400:kworker.0 00000100:00100000:1.0:1784756032.800936:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190056320 00000100:00100000:1.0:1784756032.800944:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190056320 00000100:00100000:1.0:1784756032.800973:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190056704 00000100:00100000:1.0:1784756032.800976:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190056704 00000100:00100000:1.0:1784756032.801001:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784756032.801009:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190056320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756032.801059:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190056320:12345-0@lo:400:kworker.0 Request processed in 51us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756032.801066:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784756032.801078:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784756032.801093:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190056704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756032.801135:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190056704:12345-0@lo:400:kworker.0 Request processed in 43us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756032.801141:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1784756032.801163:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756032.802044:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190056704:0@lo:400:kworker.0 00000100:00100000:2.0:1784756032.802058:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1861a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190056320:0@lo:400:kworker.0 00000100:00100000:2.0:1784756033.305063:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190056960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756033.305138:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756033.305241:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190056960 00000100:00100000:0.0:1784756033.305249:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190056960 00000100:00100000:0.0:1784756033.305299:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784756033.305307:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190056960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756033.305340:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756033.305384:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190056960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756033.305391:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1784756033.305429:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1ae2dd500 x1871452190056960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756033.305444:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190056960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756033.548081:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756033.548153:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756033.548259:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170101504 00000100:00100000:3.0:1784756033.548278:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170101504 00000100:00100000:3.0:1784756033.548348:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 203 00000100:00100000:3.0:1784756033.548360:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2349:x1871452170101504:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756033.548456:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2349:x1871452170101504:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 98us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756033.548464:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 203 00000100:00100000:2.0:1784756033.548995:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170101632 00000100:00100000:2.0:1784756033.549001:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170101632 00000100:00100000:2.0:1784756033.549058:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 52 00000100:00100000:2.0:1784756033.549066:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2349:x1871452170101632:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756033.549118:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2349:x1871452170101632:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 53us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756033.549125:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 52 00000100:00080000:1.0:1784756033.549617:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784756033.816959:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756034.847133:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756035.869300:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756036.889513:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756036.889536:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190057088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756036.889704:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784756036.890814:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756036.897105:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190057088 00000100:00100000:0.0:1784756036.897121:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190057088 00000100:00100000:0.0:1784756036.897196:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784756036.897212:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190057088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756036.897252:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756036.897332:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190057088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (7627us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756036.897339:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1784756036.897403:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc570700 x1871452190057088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756036.897421:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190057088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784756036.897719:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784756037.913037:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756037.914772:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190057216:0@lo:400:kworker.0 00000100:00100000:2.0:1784756037.916721:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190057344:0@lo:400:kworker.0 00000100:00100000:2.0:1784756037.916814:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756037.916940:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190057856:0@lo:400:kworker.0 00000100:00100000:2.0:1784756037.916972:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756037.917047:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190057472:0@lo:400:kworker.0 00000100:00100000:2.0:1784756037.917076:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756037.917101:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756037.917108:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190057600:0@lo:400:kworker.0 00000100:00100000:2.0:1784756037.917129:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756037.917164:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190057344 00000100:00100000:2.0:1784756037.917174:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190057344 00000100:00100000:0.0:1784756037.917559:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190057856 00000100:00100000:0.0:1784756037.917564:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190057856 00000100:00100000:0.0:1784756037.917630:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190057600 00000100:00100000:0.0:1784756037.917633:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190057600 00000100:00100000:0.0:1784756037.917659:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784756037.917668:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190057856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756037.917747:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190057856:12345-0@lo:400:kworker.0 Request processed in 80us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756037.917756:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784756037.917784:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784756037.917791:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190057600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756037.917824:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190057600:12345-0@lo:400:kworker.0 Request processed in 34us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756037.917850:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1784756037.917871:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784756037.917917:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc572a00 x1871452190057856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756037.917934:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190057856:0@lo:400:kworker.0 00000100:00100000:1.0:1784756037.918391:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190057472 00000100:00100000:1.0:1784756037.918398:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190057472 00000100:00100000:1.0:1784756037.918457:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784756037.918466:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190057472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756037.918514:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190057472:12345-0@lo:400:kworker.0 Request processed in 50us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756037.918521:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1784756037.918588:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756037.918921:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784756037.918932:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190057344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756037.918984:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190057344:12345-0@lo:400:kworker.0 Request processed in 53us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756037.918990:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784756037.919069:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190057344:0@lo:400:kworker.0 00010000:00080000:2.0:1784756037.919912:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc571c00 x1871452190057600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756037.919929:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190057600:0@lo:400:kworker.0 00000100:00100000:2.0:1784756037.919945:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190057472:0@lo:400:kworker.0 00000100:00100000:2.0:1784756037.920005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756037.920077:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190057728:0@lo:400:kworker.0 00000100:00100000:2.0:1784756037.920119:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756037.920220:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190057728 00000100:00100000:1.0:1784756037.920240:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190057728 00000100:00100000:1.0:1784756037.920298:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784756037.920307:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190057728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756037.920359:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190057728:12345-0@lo:400:kworker.0 Request processed in 54us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756037.920366:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784756037.920549:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190057216 00000100:00100000:3.0:1784756037.920553:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190057216 00000100:00100000:3.0:1784756037.920596:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784756037.920604:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190057216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756037.920644:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185122450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190057216:12345-0@lo:400:kworker.0 Request processed in 41us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756037.920650:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1784756037.921936:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756037.922008:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190057216:0@lo:400:kworker.0 00000100:00100000:2.0:1784756037.922046:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190057728:0@lo:400:kworker.0 00000100:00100000:3.0:1784756038.433583:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190057984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756038.433684:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756038.433778:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190057984 00000100:00100000:3.0:1784756038.433788:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190057984 00000100:00100000:3.0:1784756038.433871:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784756038.433883:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190057984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756038.433930:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756038.433981:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190057984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756038.433990:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1784756038.434055:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53dbb80 x1871452190057984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756038.434092:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190057984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756038.675748:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756038.675799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756038.675855:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170101888 00000100:00100000:1.0:1784756038.675866:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170101888 00000100:00100000:1.0:1784756038.675927:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 56 00000100:00100000:1.0:1784756038.675939:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170101888:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756038.676030:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170101888:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756038.676039:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 56 00000100:00080000:1.0:1784756038.676072:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756038.677150:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170101760 00000100:00100000:3.0:1784756038.677159:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170101760 00000100:00100000:3.0:1784756038.677205:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 205 00000100:00100000:3.0:1784756038.677212:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170101760:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756038.677269:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170101760:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 57us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756038.677277:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 205 00010000:00010000:2.0:1784756038.936994:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756039.963932:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756040.985214:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756042.009026:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756042.009812:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756042.009851:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190058112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756042.009923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756042.010070:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190058112 00000100:00100000:1.0:1784756042.010079:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190058112 00000100:00100000:1.0:1784756042.010143:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784756042.010153:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190058112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756042.010187:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756042.010234:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190058112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756042.010241:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1784756042.010280:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc570e00 x1871452190058112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756042.010299:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190058112:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784756042.010536:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784756043.034184:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190058368:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.034286:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756043.034348:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190058880:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.034376:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756043.034411:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784756043.034418:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190058240:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.034446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756043.034469:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190058752:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.034489:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756043.034518:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190058496:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.034541:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756043.034564:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756043.034569:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190058624:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.034612:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756043.034650:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190058368 00000100:00100000:0.0:1784756043.034660:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190058368 00000100:00100000:0.0:1784756043.034714:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190058752 00000100:00100000:0.0:1784756043.034717:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190058752 00000100:00100000:0.0:1784756043.034912:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190058496 00000100:00100000:0.0:1784756043.034915:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190058496 00000100:00100000:0.0:1784756043.034948:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784756043.034958:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190058368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.035042:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190058368:12345-0@lo:400:kworker.0 Request processed in 84us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756043.035051:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784756043.035078:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784756043.035085:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190058752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.035114:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190058752:12345-0@lo:400:kworker.0 Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756043.035120:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784756043.035132:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784756043.035139:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190058496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.035171:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190058496:12345-0@lo:400:kworker.0 Request processed in 33us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756043.035177:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784756043.035198:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190058880 00000100:00100000:0.0:1784756043.035202:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190058880 00000100:00100000:0.0:1784756043.035229:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190058624 00000100:00100000:0.0:1784756043.035232:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190058624 00000100:00100000:0.0:1784756043.035249:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784756043.035255:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190058880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.035286:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190058880:12345-0@lo:400:kworker.0 Request processed in 31us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756043.035292:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784756043.035303:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784756043.035309:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190058624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.035335:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190058624:12345-0@lo:400:kworker.0 Request processed in 26us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756043.035351:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784756043.035372:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190058240 00000100:00100000:0.0:1784756043.035377:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190058240 00000100:00100000:0.0:1784756043.035403:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1784756043.035409:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190058240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.035442:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190058240:12345-0@lo:400:kworker.0 Request processed in 33us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756043.035449:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:0.0:1784756043.035497:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784756043.035504:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784756043.035550:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1851cb480 x1871452190058624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756043.035567:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190058624:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.035971:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190058496:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.036009:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190058240:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.036022:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190058752:0@lo:400:kworker.0 00000100:00100000:0.0:1784756043.036033:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae2dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190058368:0@lo:400:kworker.0 00010000:00080000:0.0:1784756043.036044:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1851c9f80 x1871452190058880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756043.036055:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190058880:0@lo:400:kworker.0 00010000:00010000:3.0:1784756043.043097:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756043.266309:0:10072:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34682551 <= 34618625) for LU-18938, skip 360 00000100:00100000:0.0:1784756043.545189:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190059008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756043.545293:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756043.545463:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190059008 00000100:00100000:3.0:1784756043.545474:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190059008 00000100:00100000:3.0:1784756043.545548:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784756043.545560:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190059008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756043.545612:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756043.545675:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190059008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756043.545684:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1784756043.545944:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53dbb80 x1871452190059008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756043.545967:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190059008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756043.785993:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756043.786043:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756043.786137:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170102144 00000100:00100000:0.0:1784756043.786150:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170102144 00000100:00100000:0.0:1784756043.786248:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 60 00000100:00100000:0.0:1784756043.786261:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170102144:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1784756043.786367:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170102144:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 108us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756043.786375:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 60 00000100:00080000:2.0:1784756043.786594:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756043.786878:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170102016 00000100:00100000:3.0:1784756043.786886:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170102016 00000100:00100000:3.0:1784756043.786933:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 207 00000100:00100000:3.0:1784756043.786941:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170102016:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756043.786992:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170102016:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 51us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756043.787022:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 207 00010000:00010000:3.0:1784756044.058742:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756044.813799:0:10120:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34682551 < 34486116) for LU-14927, skip 0f 00010000:00010000:3.0:1784756045.081072:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756046.106783:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784756046.258507:0:10168:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34682551 < 34681754) for LU-12550, skip 216 00000100:00100000:0.0:1784756047.132088:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190059136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756047.132197:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756047.132306:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190059136 00000100:00100000:0.0:1784756047.132316:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190059136 00000100:00100000:0.0:1784756047.132388:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784756047.132399:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190059136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756047.132448:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00010000:3.0:1784756047.132577:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756047.133959:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190059136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1552us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756047.133981:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1784756047.134045:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784756047.134097:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b4d6f800 x1871452190059136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756047.134126:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190059136:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1784756047.840263:0:10217:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g 00010000:00010000:3.0:1784756048.153033:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756048.154102:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190059264:0@lo:400:kworker.0 00000100:00100000:0.0:1784756048.154203:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756048.154276:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190059776:0@lo:400:kworker.0 00000100:00100000:0.0:1784756048.154311:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756048.154358:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784756048.154364:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190059392:0@lo:400:kworker.0 00000100:00100000:0.0:1784756048.154391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756048.154410:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bff99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190059904:0@lo:400:kworker.0 00000100:00100000:2.0:1784756048.154481:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190059520:0@lo:400:kworker.0 00000100:00100000:2.0:1784756048.154518:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756048.154554:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756048.154561:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190059648:0@lo:400:kworker.0 00000100:00100000:2.0:1784756048.154620:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190059776 00000100:00100000:2.0:1784756048.154630:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190059776 00000100:00100000:2.0:1784756048.154689:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190059392 00000100:00100000:2.0:1784756048.154693:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190059392 00000100:00100000:2.0:1784756048.154706:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190059520 00000100:00100000:2.0:1784756048.154708:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190059520 00000100:00100000:2.0:1784756048.154727:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784756048.154737:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190059776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756048.154857:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190059264 00000100:00100000:3.0:1784756048.154863:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190059264 00000100:00100000:2.0:1784756048.154898:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190059776:12345-0@lo:400:kworker.0 Request processed in 160us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756048.154902:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784756048.154912:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784756048.154916:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190059264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756048.154938:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784756048.154947:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190059392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756048.154961:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190059264:12345-0@lo:400:kworker.0 Request processed in 48us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756048.154969:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784756048.154987:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190059392:12345-0@lo:400:kworker.0 Request processed in 41us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.155006:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784756048.155022:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784756048.155027:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190059520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756048.155076:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190059520:12345-0@lo:400:kworker.0 Request processed in 48us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.155083:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784756048.155098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784756048.155142:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756048.155176:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190059904 00000100:00100000:2.0:1784756048.155181:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190059904 00000100:00100000:0.0:1784756048.155209:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190059264:0@lo:400:kworker.0 00000100:00100000:2.0:1784756048.155224:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784756048.155230:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190059776:0@lo:400:kworker.0 00000100:00100000:2.0:1784756048.155235:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190059904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756048.155264:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190059392:0@lo:400:kworker.0 00000100:00100000:2.0:1784756048.155280:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190059904:12345-0@lo:400:kworker.0 Request processed in 48us (181us total) trans 0 rc 0/0 00010000:00080000:0.0:1784756048.155287:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bff99c00 x1871452190059904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756048.155289:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784756048.155304:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bff99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190059904:0@lo:400:kworker.0 00000100:00080000:2.0:1784756048.155308:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784756048.157252:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756048.157360:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190059520:0@lo:400:kworker.0 00000100:00100000:0.0:1784756048.158010:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190059648 00000100:00100000:0.0:1784756048.158019:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190059648 00000100:00100000:0.0:1784756048.158095:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784756048.158107:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190059648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756048.158276:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190059648:12345-0@lo:400:kworker.0 Request processed in 171us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756048.158285:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1784756048.163878:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53daa00 x1871452190059648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756048.163904:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190059648:0@lo:400:kworker.0 00000100:00100000:2.0:1784756048.665264:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190060032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756048.665379:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756048.665799:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190060032 00000100:00100000:0.0:1784756048.665811:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190060032 00000100:00100000:0.0:1784756048.665929:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784756048.665942:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190060032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756048.665992:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756048.666266:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190060032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 325us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756048.666292:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1784756048.666356:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1851c8380 x1871452190060032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756048.666379:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190060032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756048.909263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756048.909327:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756048.909528:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170102400 00000100:00100000:2.0:1784756048.909541:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170102400 00000100:00100000:2.0:1784756048.909662:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 64 00000100:00100000:2.0:1784756048.909675:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:2347:x1871452170102400:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756048.909791:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:2347:x1871452170102400:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 118us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756048.909800:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 64 00000100:00080000:1.0:1784756048.910132:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756048.911477:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170102272 00000100:00100000:3.0:1784756048.911490:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170102272 00000100:00100000:3.0:1784756048.913894:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 209 00000100:00100000:3.0:1784756048.913941:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170102272:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756048.914053:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170102272:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 138us (4724us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756048.914062:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 209 00010000:00010000:3.0:1784756049.176982:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784756049.435117:0:10265:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 00010000:00010000:3.0:1784756050.201047:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756051.225456:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784756051.370808:0:10313:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 17:34:09 (1784756049) === 00010000:00010000:3.0:1784756052.248988:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756052.254924:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756052.254944:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190060160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756052.255016:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756052.255079:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190060160 00000100:00100000:1.0:1784756052.255094:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190060160 00000100:00080000:0.0:1784756052.255158:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784756052.255163:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784756052.255174:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190060160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756052.255213:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756052.255268:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190060160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756052.255276:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1784756052.255373:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b4d6d180 x1871452190060160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756052.255391:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190060160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756053.274151:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190060288:0@lo:400:kworker.0 00000100:00100000:3.0:1784756053.274303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784756053.275320:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756053.276184:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190060288 00000100:00100000:0.0:1784756053.276198:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190060288 00000100:00100000:0.0:1784756053.276253:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1784756053.276274:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190060288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756053.278441:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190060288:12345-0@lo:400:kworker.0 Request processed in 2172us (4131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756053.278455:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1784756053.278472:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190060288:0@lo:400:kworker.0 00000100:00100000:2.0:1784756053.278791:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190060416:0@lo:400:kworker.0 00000100:00100000:2.0:1784756053.278867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756053.278911:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190060928:0@lo:400:kworker.0 00000100:00100000:2.0:1784756053.278937:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756053.278959:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784756053.278965:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190060800:0@lo:400:kworker.0 00000100:00100000:2.0:1784756053.278989:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756053.279015:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190060544:0@lo:400:kworker.0 00000100:00100000:2.0:1784756053.279038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756053.279055:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756053.279060:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190060672:0@lo:400:kworker.0 00000100:00100000:2.0:1784756053.279098:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756053.279146:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190060416 00000100:00100000:2.0:1784756053.279152:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190060416 00000100:00100000:2.0:1784756053.279191:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190060800 00000100:00100000:2.0:1784756053.279195:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190060800 00000100:00100000:2.0:1784756053.279705:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190060928 00000100:00100000:2.0:1784756053.279711:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190060928 00000100:00100000:2.0:1784756053.279760:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190060672 00000100:00100000:2.0:1784756053.279764:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190060672 00000100:00100000:2.0:1784756053.279784:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784756053.279791:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190060928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756053.280019:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190060544 00000100:00100000:0.0:1784756053.280025:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190060544 00000100:00100000:0.0:1784756053.280048:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784756053.280055:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190060416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756053.280438:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190060928:12345-0@lo:400:kworker.0 Request processed in 645us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756053.280446:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784756053.280463:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784756053.280470:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190060672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756053.280559:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190060672:12345-0@lo:400:kworker.0 Request processed in 90us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756053.280566:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1784756053.280583:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784756053.280588:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756053.280620:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784756053.280625:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190060544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756053.280654:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190060544:12345-0@lo:400:kworker.0 Request processed in 29us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756053.280659:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784756053.280674:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784756053.280678:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190060800:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1784756053.281112:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc570a80 x1871452190060672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756053.281129:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190060672:0@lo:400:kworker.0 00000100:00100000:3.0:1784756053.281144:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190060544:0@lo:400:kworker.0 00000100:00100000:0.0:1784756053.281178:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190060416:12345-0@lo:400:kworker.0 Request processed in 1122us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756053.281193:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784756053.281369:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190060800:12345-0@lo:400:kworker.0 Request processed in 689us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756053.281377:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1784756053.281392:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756053.281467:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190060800:0@lo:400:kworker.0 00000100:00100000:2.0:1784756053.281479:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190060416:0@lo:400:kworker.0 00010000:00080000:2.0:1784756053.281491:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc570000 x1871452190060928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756053.281499:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190060928:0@lo:400:kworker.0 00000100:00100000:0.0:1784756053.790014:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190061056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756053.790083:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756053.790150:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190061056 00000100:00100000:0.0:1784756053.790158:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190061056 00000100:00100000:0.0:1784756053.790204:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784756053.790214:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1851cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190061056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756053.791016:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756053.791075:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1851cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190061056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 861us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756053.791083:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1784756053.791136:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1851c8a80 x1871452190061056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756053.791155:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190061056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756054.022092:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756054.022141:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756054.022205:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170102656 00000100:00100000:2.0:1784756054.022214:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170102656 00000100:00100000:2.0:1784756054.022280:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 68 00000100:00100000:2.0:1784756054.022289:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:2347:x1871452170102656:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756054.022376:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:2347:x1871452170102656:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 87us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756054.022383:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 68 00000100:00100000:3.0:1784756054.022526:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170102528 00000100:00100000:3.0:1784756054.022531:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170102528 00000100:00100000:3.0:1784756054.022581:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 211 00000100:00100000:3.0:1784756054.022589:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170102528:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756054.022622:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185120450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170102528:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 34us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756054.022628:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 211 00000100:00080000:1.0:1784756054.022871:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784756054.297314:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756055.323983:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756056.344992:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784756057.293381:0:10506:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg421-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1784756057.373939:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190061184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756057.374012:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756057.374100:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190061184 00000100:00100000:2.0:1784756057.374108:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190061184 00000100:00100000:2.0:1784756057.374164:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784756057.374172:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190061184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756057.374208:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756057.374252:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190061184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756057.374258:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1784756057.374278:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784756057.374307:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa18000 x1871452190061184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756057.374333:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190061184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784756057.375956:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756058.393015:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756058.393450:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190061440:0@lo:400:kworker.0 00000100:00100000:0.0:1784756058.393545:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756058.393613:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190061952:0@lo:400:kworker.0 00000100:00100000:0.0:1784756058.393652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756058.393685:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784756058.393691:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190061312:0@lo:400:kworker.0 00000100:00100000:0.0:1784756058.393718:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756058.393737:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190061824:0@lo:400:kworker.0 00000100:00100000:0.0:1784756058.393768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756058.393795:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190061568:0@lo:400:kworker.0 00000100:00100000:0.0:1784756058.393818:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756058.393827:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190061440 00000100:00100000:2.0:1784756058.393850:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190061440 00000100:00100000:0.0:1784756058.393852:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784756058.393858:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190061696:0@lo:400:kworker.0 00000100:00100000:2.0:1784756058.393893:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190061824 00000100:00100000:2.0:1784756058.393896:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190061824 00000100:00100000:2.0:1784756058.393918:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190061568 00000100:00100000:2.0:1784756058.393921:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190061568 00000100:00100000:2.0:1784756058.393938:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784756058.393946:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190061440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756058.394019:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190061440:12345-0@lo:400:kworker.0 Request processed in 73us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756058.394032:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784756058.394043:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756058.394051:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784756058.394057:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190061824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756058.394086:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190061824:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756058.394091:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784756058.394094:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190061952 00000100:00100000:0.0:1784756058.394097:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190061952 00000100:00100000:2.0:1784756058.394102:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784756058.394107:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190061568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756058.394121:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190061696 00000100:00100000:0.0:1784756058.394124:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190061696 00000100:00100000:2.0:1784756058.394136:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190061568:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756058.394142:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784756058.394143:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784756058.394148:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190061952:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784756058.394160:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784756058.394164:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756058.394193:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190061952:12345-0@lo:400:kworker.0 Request processed in 44us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756058.394199:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784756058.394577:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784756058.394584:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190061696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756058.394614:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190061696:12345-0@lo:400:kworker.0 Request processed in 30us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756058.394619:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784756058.394649:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190061312 00000100:00100000:0.0:1784756058.394653:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190061312 00000100:00100000:0.0:1784756058.394681:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1784756058.394687:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190061312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756058.394712:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190061312:12345-0@lo:400:kworker.0 Request processed in 26us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756058.394727:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1784756058.395517:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1851c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190061312:0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.395534:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190061824:0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.395543:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190061440:0@lo:400:kworker.0 00010000:00080000:1.0:1784756058.395555:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53d8e00 x1871452190061952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756058.395564:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190061952:0@lo:400:kworker.0 00010000:00080000:1.0:1784756058.395611:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53d9500 x1871452190061696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756058.395619:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190061696:0@lo:400:kworker.0 00000100:00100000:1.0:1784756058.395639:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190061568:0@lo:400:kworker.0 00000100:00100000:0.0:1784756058.904975:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756058.905025:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190062080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756058.905098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756058.905167:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190062080 00000100:00100000:0.0:1784756058.905174:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190062080 00000100:00100000:0.0:1784756058.905220:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784756058.905230:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190062080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756058.905267:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756058.905312:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf544a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190062080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756058.905319:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1784756058.905379:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bf545180 x1871452190062080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756058.905396:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190062080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756059.159514:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756059.159595:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756059.160080:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170102912 00000100:00100000:0.0:1784756059.160090:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170102912 00000100:00100000:0.0:1784756059.160178:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 72 00000100:00100000:0.0:1784756059.160190:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170102912:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1784756059.160267:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170102912:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 80us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756059.160275:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 72 00000100:00080000:2.0:1784756059.161163:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756059.162021:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170102784 00000100:00100000:3.0:1784756059.162136:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170102784 00000100:00100000:3.0:1784756059.162212:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 213 00000100:00100000:3.0:1784756059.162221:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170102784:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756059.162298:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170102784:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 77us (2792us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756059.162306:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 213 00010000:00010000:3.0:1784756059.417005:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756060.441308:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756061.465034:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756062.488995:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756062.489019:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756062.489041:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190062208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756062.489119:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756062.489183:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190062208 00000100:00100000:2.0:1784756062.489193:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190062208 00000100:00080000:3.0:1784756062.489257:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784756062.489262:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784756062.489275:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190062208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756062.489311:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1784756062.489489:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa19c00 x1871452190062208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756062.489508:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190062208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784756062.489612:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190062208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756062.489629:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784756063.513249:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190062720:0@lo:400:kworker.0 00000100:00100000:2.0:1784756063.513348:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756063.513455:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784756063.513461:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190062592:0@lo:400:kworker.0 00000100:00100000:2.0:1784756063.513490:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756063.513704:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190062720 00000100:00100000:0.0:1784756063.513716:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190062720 00000100:00100000:3.0:1784756063.513731:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190062336:0@lo:400:kworker.0 00000100:00100000:3.0:1784756063.513779:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756063.513788:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784756063.513812:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190062720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756063.513813:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190062848:0@lo:400:kworker.0 00000100:00100000:3.0:1784756063.513869:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756063.513894:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784756063.513903:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190062464:0@lo:400:kworker.0 00000100:00100000:0.0:1784756063.513918:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190062720:12345-0@lo:400:kworker.0 Request processed in 109us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756063.513928:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784756063.513934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756063.513960:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190062976:0@lo:400:kworker.0 00000100:00100000:0.0:1784756063.513969:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190062592 00000100:00100000:0.0:1784756063.513974:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190062592 00000100:00100000:0.0:1784756063.514011:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190062848 00000100:00100000:0.0:1784756063.514014:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190062848 00000100:00100000:0.0:1784756063.514028:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190062464 00000100:00100000:0.0:1784756063.514031:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190062464 00000100:00100000:0.0:1784756063.514043:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784756063.514049:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190062592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756063.514064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756063.514136:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190062976 00000100:00100000:2.0:1784756063.514141:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190062976 00000100:00100000:2.0:1784756063.514171:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784756063.514177:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190062976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756063.514428:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1871452190062592:12345-0@lo:400:kworker.0 Request processed in 377us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756063.514436:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784756063.514457:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784756063.514466:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190062336 00000100:00100000:0.0:1784756063.514466:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190062848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756063.514473:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190062336 00000100:00100000:0.0:1784756063.514526:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190062848:12345-0@lo:400:kworker.0 Request processed in 60us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756063.514528:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1784756063.514550:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784756063.514555:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190062336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756063.514572:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784756063.514582:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190062464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756063.514599:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185121450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190062336:12345-0@lo:400:kworker.0 Request processed in 47us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756063.514607:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1784756063.514626:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190062464:12345-0@lo:400:kworker.0 Request processed in 45us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756063.514633:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1784756063.514669:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784756063.514675:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784756063.514689:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756063.514743:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190062464:0@lo:400:kworker.0 00000100:00100000:3.0:1784756063.514750:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1871452190062592:0@lo:400:kworker.0 00000100:00100000:0.0:1784756063.514760:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190062336:0@lo:400:kworker.0 00010000:00080000:3.0:1784756063.514774:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa1b800 x1871452190062720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756063.514780:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190062848:0@lo:400:kworker.0 00000100:00100000:3.0:1784756063.514795:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190062720:0@lo:400:kworker.0 00000100:00100000:2.0:1784756063.520038:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190062976:12345-0@lo:400:kworker.0 Request processed in 5840us (5955us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756063.520060:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1784756063.520093:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa19180 x1871452190062976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756063.520115:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190062976:0@lo:400:kworker.0 00000100:00100000:0.0:1784756064.035715:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190063104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756064.035811:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756064.036220:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190063104 00000100:00100000:2.0:1784756064.036231:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190063104 00000100:00100000:2.0:1784756064.036288:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784756064.036299:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190063104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756064.036350:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756064.036419:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190063104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756064.036427:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1784756064.036474:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bf545180 x1871452190063104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756064.036496:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190063104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756064.262345:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756064.262402:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756064.262431:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170103040 00000100:00100000:3.0:1784756064.262440:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170103040 00000100:00100000:3.0:1784756064.262484:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 215 00000100:00100000:3.0:1784756064.262493:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2349:x1871452170103040:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756064.262580:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185123c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2349:x1871452170103040:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756064.262587:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 215 00000100:00100000:1.0:1784756064.262771:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170103168 00000100:00100000:1.0:1784756064.262776:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170103168 00000100:00100000:1.0:1784756064.262825:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 76 00000100:00100000:1.0:1784756064.262853:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2349:x1871452170103168:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756064.262915:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2349:x1871452170103168:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 73us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756064.262923:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 76 00000100:00080000:3.0:1784756064.263683:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784756064.537773:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756065.560934:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756066.585206:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756067.608926:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756067.609074:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190063232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756067.609141:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756067.609319:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190063232 00000100:00100000:2.0:1784756067.609327:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190063232 00000100:00100000:2.0:1784756067.609390:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784756067.609399:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190063232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756067.609432:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756067.609505:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190063232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756067.609525:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1784756067.609593:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa19500 x1871452190063232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756067.609611:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190063232:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784756067.609705:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784756068.633644:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190063616:0@lo:400:kworker.0 00000100:00100000:3.0:1784756068.633700:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190063360:0@lo:400:kworker.0 00000100:00100000:2.0:1784756068.633721:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756068.633817:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190063488:0@lo:400:kworker.0 00000100:00100000:2.0:1784756068.644268:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784756068.644289:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190063744:0@lo:400:kworker.0 00000100:00100000:2.0:1784756068.644356:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756068.644423:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190063616 00000100:00100000:2.0:1784756068.644430:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190063616 00000100:00100000:2.0:1784756068.644494:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784756068.644504:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190063616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756068.644559:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190063616:12345-0@lo:400:kworker.0 Request processed in 57us (10839us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756068.644566:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784756068.644590:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190063744 00000100:00100000:2.0:1784756068.644593:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190063744 00000100:00100000:2.0:1784756068.644618:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784756068.644624:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190063744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756068.644655:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190063744:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756068.644661:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1784756068.644676:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784756068.644710:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa18700 x1871452190063744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756068.644723:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190063744:0@lo:400:kworker.0 00000100:00100000:2.0:1784756068.644737:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190063616:0@lo:400:kworker.0 00000100:00100000:3.0:1784756068.650063:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756068.651098:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190063872:0@lo:400:kworker.0 00000100:00100000:3.0:1784756068.651181:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784756068.651531:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756068.651543:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190063872 00000100:00100000:2.0:1784756068.651560:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190063872 00000100:00100000:2.0:1784756068.651657:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784756068.651672:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190063872:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784756068.651680:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756068.651784:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190063872:12345-0@lo:400:kworker.0 Request processed in 115us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756068.651792:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784756068.652930:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190063872:0@lo:400:kworker.0 00000100:00100000:0.0:1784756068.659823:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190063360 00000100:00100000:0.0:1784756068.659852:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190063360 00000100:00100000:0.0:1784756068.659915:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1784756068.659925:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190063360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756068.660037:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190063360:12345-0@lo:400:kworker.0 Request processed in 113us (9986us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756068.660045:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1784756068.660671:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190063360:0@lo:400:kworker.0 00000100:00100000:1.0:1784756068.663677:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756068.663737:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190064000:0@lo:400:kworker.0 00000100:00100000:1.0:1784756068.663789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756068.663909:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190063488 00000100:00100000:2.0:1784756068.663918:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190063488 00000100:00100000:2.0:1784756068.663966:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784756068.663975:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190063488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756068.664029:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190064000 00000100:00100000:0.0:1784756068.664033:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190064000 00000100:00100000:2.0:1784756068.664044:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190063488:12345-0@lo:400:kworker.0 Request processed in 70us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756068.664051:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784756068.664087:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784756068.664094:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190064000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756068.664133:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190064000:12345-0@lo:400:kworker.0 Request processed in 39us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756068.664139:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1784756068.664159:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784756068.664231:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190063488:0@lo:400:kworker.0 00010000:00080000:1.0:1784756068.664245:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa19500 x1871452190064000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756068.664255:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190064000:0@lo:400:kworker.0 00000100:00100000:1.0:1784756069.144991:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190064128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756069.145056:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756069.145122:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190064128 00000100:00100000:1.0:1784756069.145129:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190064128 00000100:00100000:1.0:1784756069.145170:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784756069.145179:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190064128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756069.145214:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756069.145256:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190064128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756069.145264:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1784756069.145300:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b4d6e680 x1871452190064128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756069.145318:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190064128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756069.392575:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756069.392668:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756069.392963:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170103424 00000100:00100000:1.0:1784756069.392973:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170103424 00000100:00100000:1.0:1784756069.393057:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 80 00000100:00100000:1.0:1784756069.393067:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170103424:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756069.393140:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170103424:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 74us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756069.393148:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 80 00000100:00080000:0.0:1784756069.394288:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756069.395037:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170103296 00000100:00100000:3.0:1784756069.395046:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170103296 00000100:00100000:3.0:1784756069.395100:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 217 00000100:00100000:3.0:1784756069.395110:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170103296:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756069.395181:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170103296:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 72us (2615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756069.395188:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 217 00010000:00010000:3.0:1784756069.657983:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756070.680985:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756071.710781:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756072.728985:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756072.729223:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190064256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756072.729366:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756072.731191:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190064256 00000100:00100000:2.0:1784756072.731204:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190064256 00000100:00100000:2.0:1784756072.731315:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784756072.731325:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190064256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756072.731433:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756072.731650:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190064256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 326us (2295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756072.731658:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1784756072.731784:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784756072.735788:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa18380 x1871452190064256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756072.735824:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190064256:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1784756073.191307:0:11204:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1784756073.755036:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190064512:0@lo:400:kworker.0 00000100:00100000:1.0:1784756073.755112:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756073.755165:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190065024:0@lo:400:kworker.0 00000100:00100000:1.0:1784756073.755187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756073.755212:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784756073.755217:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190064384:0@lo:400:kworker.0 00000100:00100000:1.0:1784756073.755240:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756073.755260:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190064896:0@lo:400:kworker.0 00000100:00100000:1.0:1784756073.755276:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756073.755295:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190064640:0@lo:400:kworker.0 00000100:00100000:1.0:1784756073.755313:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756073.755328:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756073.755332:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190064768:0@lo:400:kworker.0 00000100:00100000:1.0:1784756073.755364:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756073.755393:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190064384 00000100:00100000:1.0:1784756073.755416:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190064384 00000100:00100000:2.0:1784756073.755612:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190064512 00000100:00100000:2.0:1784756073.755617:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190064512 00000100:00100000:2.0:1784756073.755642:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190064896 00000100:00100000:2.0:1784756073.755645:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190064896 00000100:00100000:2.0:1784756073.755661:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190064640 00000100:00100000:2.0:1784756073.755663:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190064640 00000100:00100000:2.0:1784756073.755675:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784756073.755683:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190064512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756073.755739:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190064512:12345-0@lo:400:kworker.0 Request processed in 56us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756073.755746:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784756073.755760:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784756073.755766:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190064896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756073.755788:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190064896:12345-0@lo:400:kworker.0 Request processed in 23us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756073.755794:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784756073.755803:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784756073.755808:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190064640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756073.755871:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190064640:12345-0@lo:400:kworker.0 Request processed in 62us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756073.755877:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784756073.755893:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190065024 00000100:00100000:2.0:1784756073.755896:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190065024 00000100:00100000:2.0:1784756073.755917:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190064768 00000100:00100000:2.0:1784756073.755919:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190064768 00000100:00100000:2.0:1784756073.755932:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784756073.755937:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190065024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756073.756145:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190065024:12345-0@lo:400:kworker.0 Request processed in 27us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756073.756159:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784756073.756173:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784756073.756178:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190064768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756073.756209:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190064768:12345-0@lo:400:kworker.0 Request processed in 31us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756073.756214:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1784756073.756260:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b4d6d180 x1871452190064768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756073.756273:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190064768:0@lo:400:kworker.0 00000100:00100000:2.0:1784756073.756283:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190064640:0@lo:400:kworker.0 00000100:00100000:2.0:1784756073.756313:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190064896:0@lo:400:kworker.0 00000100:00100000:2.0:1784756073.756322:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190064512:0@lo:400:kworker.0 00010000:00080000:2.0:1784756073.756330:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b4d6c000 x1871452190065024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756073.756350:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190065024:0@lo:400:kworker.0 00000100:00080000:0.0:1784756073.756484:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784756073.756489:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784756073.757666:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756073.757758:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784756073.757771:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190064384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756073.757857:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190064384:12345-0@lo:400:kworker.0 Request processed in 90us (2615us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756073.757864:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1784756073.758596:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190064384:0@lo:400:kworker.0 00000100:00100000:3.0:1784756074.272030:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784756074.272106:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190065152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756074.272246:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756074.272393:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190065152 00000100:00100000:3.0:1784756074.272414:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190065152 00000100:00100000:3.0:1784756074.272501:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784756074.272510:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190065152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756074.272572:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756074.272613:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190065152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756074.272619:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1784756074.273051:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1b53dbb80 x1871452190065152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756074.273073:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190065152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756074.509231:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756074.509273:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756074.509303:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170103680 00000100:00100000:2.0:1784756074.509312:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170103680 00000100:00100000:2.0:1784756074.509600:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 84 00000100:00100000:2.0:1784756074.509612:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170103680:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756074.509700:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170103680:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 90us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756074.509709:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 84 00000100:00080000:2.0:1784756074.509731:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756074.510431:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170103552 00000100:00100000:3.0:1784756074.510437:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170103552 00000100:00100000:3.0:1784756074.510467:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 219 00000100:00100000:3.0:1784756074.510474:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170103552:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756074.510522:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170103552:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 47us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756074.510529:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 219 00010000:00010000:3.0:1784756074.786224:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756075.801255:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756076.825167:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784756077.401739:0:11352:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6a5efad0 20000000:00000080:2.0:1784756077.401759:0:11352:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96f185021400 uarg=0000000000000000 20000000:01000000:2.0:1784756077.402007:0:11352:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784756077.402013:0:11352:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784756077.402018:0:11352:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1784756077.403488:0:11353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1784756077.403676:0:11352:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784756077.410957:0:11352:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784756077.411074:0:11352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756077.411096:0:11352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f185038c00/0xbe94f39231c84f98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cfb expref: 9 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756077.411122:0:11352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f186aac800/0xbe94f39231c84fa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84f9f expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756077.411130:0:11352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f180030600/0xbe94f39231c84fb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84fad expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756077.411136:0:11352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96f186aacc00/0xbe94f39231c84fc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84fbb expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756077.411143:0:11352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756077.411186:0:11352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f186aacc00/0xbe94f39231c84fc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84fbb expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756077.411207:0:11352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96f186aacc00/0xbe94f39231c84fc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84fbb expref: 18 pid: 5776 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756077.411218:0:11352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bff9a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11352:1871452190065280:0@lo:104: 00000100:00100000:3.0:1784756077.411279:0:11352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784756077.411335:0:11352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f180030600/0xbe94f39231c84fb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84fad expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756077.411343:0:11352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96f180030600/0xbe94f39231c84fb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84fad expref: 18 pid: 5774 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756077.411351:0:11352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bff98380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11352:1871452190065408:0@lo:104: 00000100:00100000:3.0:1784756077.411372:0:11352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784756077.411467:0:11352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f186aac800/0xbe94f39231c84fa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbe94f39231c84f9f expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756077.411482:0:11352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96f186aac800/0xbe94f39231c84fa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbe94f39231c84f9f expref: 18 pid: 5777 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756077.411490:0:11352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bff9b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11352:1871452190065536:0@lo:104: 00000100:00100000:3.0:1784756077.411512:0:11352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784756077.425123:0:11352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96f185038c00/0xbe94f39231c84f98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cfb expref: 9 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756077.425144:0:11352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96f185038c00/0xbe94f39231c84f98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cfb expref: 9 pid: 5774 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756077.425160:0:11352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bff98000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11352:1871452190065664:192.168.204.21@tcp:104: 00000100:00100000:3.0:1784756077.425242:0:11352:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186922d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784756077.433030:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190065280 00000100:00100000:1.0:1784756077.433046:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190065280 00000100:00100000:1.0:1784756077.433106:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190065408 00000100:00100000:1.0:1784756077.433110:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190065408 00000100:00100000:1.0:1784756077.433121:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190065536 00000100:00100000:1.0:1784756077.433123:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190065536 00000100:00100000:1.0:1784756077.433139:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784756077.433148:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+5:11352:x1871452190065280:12345-0@lo:104: 00010000:00010000:1.0:1784756077.433166:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.433283:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784756077.433290:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+5:11352:x1871452190065280:12345-0@lo:104: Request processed in 143us (22011us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756077.433297:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784756077.433314:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784756077.433320:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+4:11352:x1871452190065408:12345-0@lo:104: 00010000:00010000:1.0:1784756077.433328:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.433366:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784756077.433370:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+4:11352:x1871452190065408:12345-0@lo:104: Request processed in 51us (21998us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756077.433389:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784756077.433414:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784756077.433420:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:11352:x1871452190065536:12345-0@lo:104: 00010000:00010000:1.0:1784756077.433427:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.433435:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784756077.433441:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.433449:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aad600 already unused, calling callback (ffffffffc1a1cc20) 00010000:00010000:1.0:1784756077.433452:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:0.0:1784756077.433453:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756077.433456:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f9117e42-6e26-4b4a-b619-3540b762413c+3:11352:x1871452190065536:12345-0@lo:104: Request processed in 37us (21944us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756077.433462:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1784756077.433462:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784756077.433470:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756077.433475:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784756077.433489:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784756077.433509:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.433516:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784756077.433545:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.433552:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f186aad600/0xbe94f39231c84fbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84fc2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.433564:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784756077.433568:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.433578:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f180031400 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:0.0:1784756077.433581:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.433587:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784756077.433593:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784756077.433599:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784756077.433612:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.433618:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784756077.433633:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.433634:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756077.433640:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.433640:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f180031400/0xbe94f39231c84f9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84fa6 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.433647:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f180031a00 already unused, calling callback (ffffffffc1a1cc20) 10000000:00010000:1.0:1784756077.433650:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.433650:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756077.433651:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756077.433653:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756077.433656:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784756077.433662:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756077.433666:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190065792:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1784756077.433667:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784756077.433679:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.433694:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784756077.433701:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756077.433704:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784756077.433707:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.121@tcp lock: ffff96f180031a00/0xbe94f39231c84fad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbe94f39231c84fb4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.433720:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756077.433721:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756077.433723:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756077.433727:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756077.433729:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756077.433747:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190065920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784756077.433782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756077.433815:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756077.433821:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190066048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784756077.433860:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756077.433887:0:7485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190065792 00000100:00100000:0.0:1784756077.433891:0:7485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190065792 00010000:00010000:0.0:1784756077.433910:0:7485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f186aacc00/0xbe94f39231c84fc2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84fbb expref: 19 pid: 5776 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756077.433929:0:7485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190065920 00000100:00100000:0.0:1784756077.433932:0:7485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190065920 00010000:00010000:0.0:1784756077.433942:0:7485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f186aac800/0xbe94f39231c84fa6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84f9f expref: 20 pid: 5777 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756077.433952:0:7485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190066048 00000100:00100000:0.0:1784756077.433954:0:7485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190066048 00010000:00010000:0.0:1784756077.433963:0:7485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f180030600/0xbe94f39231c84fb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84fad expref: 21 pid: 5774 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756077.433974:0:7485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784756077.433980:0:7485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1838ae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9117e42-6e26-4b4a-b619-3540b762413c+21:3303:x1871452190065792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784756077.433990:0:7485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756077.433995:0:7485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f186aacc00/0xbe94f39231c84fc2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84fbb expref: 21 pid: 5776 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.434006:0:7485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f186aacc00/0xbe94f39231c84fc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84fbb expref: 21 pid: 5776 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.434022:0:7485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784756077.434049:0:7485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1838ae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9117e42-6e26-4b4a-b619-3540b762413c+21:3303:x1871452190065792:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756077.434055:0:7485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784756077.434073:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784756077.434079:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf547b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+20:3300:x1871452190065920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784756077.434087:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756077.434092:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f186aac800/0xbe94f39231c84fa6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84f9f expref: 20 pid: 5777 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.434101:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f186aac800/0xbe94f39231c84fa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84f9f expref: 20 pid: 5777 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.434110:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756077.434136:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf547b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+20:3300:x1871452190065920:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756077.434142:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784756077.434156:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784756077.434161:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190066048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784756077.434168:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756077.434178:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f180030600/0xbe94f39231c84fb4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbe94f39231c84fad expref: 19 pid: 5774 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.434186:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f180030600/0xbe94f39231c84fb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbe94f39231c84fad expref: 19 pid: 5774 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.434195:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756077.434217:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190066048:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756077.434223:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784756077.435040:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190065792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784756077.435069:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190066048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784756077.435077:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190065920:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784756077.435114:0:11352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f186aacc00/0xbe94f39231c84fc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84fbb expref: 18 pid: 5776 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756077.435129:0:11352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bff9a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11352:1871452190065280:0@lo:104: 00010000:00010000:3.0:1784756077.435139:0:11352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f180030600/0xbe94f39231c84fb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84fad expref: 17 pid: 5774 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756077.435148:0:11352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bff98380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11352:1871452190065408:0@lo:104: 00010000:00010000:3.0:1784756077.435156:0:11352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f186aac800/0xbe94f39231c84fa6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbe94f39231c84f9f expref: 16 pid: 5777 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756077.435163:0:11352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bff9b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11352:1871452190065536:0@lo:104: 00000100:00100000:1.0:1784756077.435922:0:11352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bff98000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11352:1871452190065664:192.168.204.21@tcp:104: 00010000:00010000:1.0:1784756077.435946:0:11352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756077.436997:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756077.437109:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170103808 00000100:00100000:1.0:1784756077.437115:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170103808 00010000:00010000:1.0:1784756077.437142:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96f185038c00/0xbe94f39231c84f98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cfb expref: 10 pid: 5774 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756077.437174:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 28 00000100:00100000:1.0:1784756077.437182:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170103808:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784756077.437195:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756077.437208:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96f185038c00/0xbe94f39231c84f98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cfb expref: 10 pid: 5774 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437218:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96f185038c00/0xbe94f39231c84f98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cfb expref: 10 pid: 5774 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437234:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f185038c00/0xbe94f39231c84f98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1cfb expref: 10 pid: 5774 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437278:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437286:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437301:0:5767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437309:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437316:0:5767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437323:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437330:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181500000 already unused, calling callback (ffffffffc1436230) 00010000:00010000:1.0:1784756077.437333:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437341:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437358:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.437368:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784756077.437423:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:994158a7-52a9-48df-b40e-50a3e29f70de+9:2347:x1871452170103808:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 241us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756077.437436:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 28 00010000:00010000:0.0:1784756077.438173:0:11352:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.438183:0:11352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756077.439061:0:11352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96f181500000/0xbe94f39231c84fc9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756077.849247:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756077.850033:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784756077.850113:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190066176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756077.850209:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756077.850352:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190066176 00000100:00100000:2.0:1784756077.850360:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190066176 00000100:00080000:0.0:1784756077.850419:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784756077.850452:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784756077.850462:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bff98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190066176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756077.850494:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756077.850548:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bff98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190066176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756077.850556:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1784756077.850932:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa1b800 x1871452190066176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756077.850952:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190066176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756078.469441:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756078.469801:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170103936 00000100:00100000:0.0:1784756078.469813:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170103936 00000100:00100000:0.0:1784756078.469916:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 220 00000100:00100000:0.0:1784756078.469929:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+9:5561:x1871452170103936:12345-192.168.204.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784756078.469952:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756078.469981:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f186aac000/0xbe94f39231c84fd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d02 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756078.470027:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f186aac000/0xbe94f39231c84fd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d02 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756078.470073:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f186aac000/0xbe94f39231c84fd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d02 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756078.470085:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aac000, rc 0) 00000100:00100000:0.0:1784756078.470160:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170103936:12345-192.168.204.21@tcp:101:ll_cfg_requeue.0 Request processed in 233us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756078.470168:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 220 00000100:00100000:0.0:1784756078.479820:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756078.480818:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170104064 00000100:00100000:3.0:1784756078.480898:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170104064 00000100:00100000:3.0:1784756078.480977:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 221 00000100:00100000:3.0:1784756078.480988:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170104064:12345-192.168.204.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756078.481285:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170104064:12345-192.168.204.21@tcp:501:ll_cfg_requeue.0 Request processed in 298us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756078.481294:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 221 00000100:00100000:1.0:1784756078.486686:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756078.487117:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170104192 00000100:00100000:3.0:1784756078.487134:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170104192 00000100:00100000:3.0:1784756078.487709:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 222 00000100:00100000:3.0:1784756078.487721:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170104192:12345-192.168.204.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756078.488074:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:5561:x1871452170104192:12345-192.168.204.21@tcp:503:ll_cfg_requeue.0 Request processed in 353us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756078.488084:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 222 00010000:00010000:3.0:1784756078.873486:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756078.876163:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bff99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190066688:0@lo:400:kworker.0 00000100:00100000:1.0:1784756078.876168:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bff9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190066304:0@lo:400:kworker.0 00000100:00100000:3.0:1784756078.882581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756078.882672:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bff98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190066432:0@lo:400:kworker.0 00000100:00100000:3.0:1784756078.882706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756078.882724:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190066944:0@lo:400:kworker.0 00000100:00100000:3.0:1784756078.882741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756078.882762:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784756078.882786:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190066688 00000100:00100000:3.0:1784756078.882792:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bff9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1871452190066560:0@lo:400:kworker.0 00000100:00100000:1.0:1784756078.882795:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190066688 00000100:00100000:3.0:1784756078.882816:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756078.883180:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190066944 00000100:00100000:1.0:1784756078.883185:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190066944 00000100:00100000:1.0:1784756078.883234:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784756078.883258:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1a0357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190066688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756078.883323:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1a0357c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190066688:12345-0@lo:400:kworker.0 Request processed in 68us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756078.883331:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784756078.883338:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190066432 00000100:00100000:3.0:1784756078.883343:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190066432 00000100:00100000:3.0:1784756078.883372:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190066560 00000100:00100000:3.0:1784756078.883374:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190066560 00000100:00100000:3.0:1784756078.883398:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784756078.883406:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190066432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756078.883447:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190066432:12345-0@lo:400:kworker.0 Request processed in 42us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756078.883454:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784756078.883469:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784756078.883476:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1871452190066560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756078.883503:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1871452190066560:12345-0@lo:400:kworker.0 Request processed in 29us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756078.883508:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784756078.883524:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784756078.883530:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190066944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756078.883552:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190066944:12345-0@lo:400:kworker.0 Request processed in 22us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756078.883557:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784756078.883726:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bff9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1871452190066560:0@lo:400:kworker.0 00000100:00100000:3.0:1784756078.883736:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bff98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190066432:0@lo:400:kworker.0 00010000:00080000:3.0:1784756078.883746:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc572d80 x1871452190066944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756078.883756:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190066944:0@lo:400:kworker.0 00010000:00080000:3.0:1784756078.883805:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bff99c00 x1871452190066688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756078.883814:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bff99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190066688:0@lo:400:kworker.0 00000100:00080000:1.0:1784756078.889222:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784756078.889233:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784756078.889319:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756078.889391:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1871452190066816:0@lo:400:kworker.0 00000100:00100000:1.0:1784756078.889429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756078.892120:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190066304 00000100:00100000:3.0:1784756078.892133:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190066304 00000100:00100000:3.0:1784756078.892203:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784756078.892214:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:3303:x1871452190066304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756078.892316:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+16:3303:x1871452190066304:12345-0@lo:400:kworker.0 Request processed in 104us (2999us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756078.892324:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784756078.892366:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190066816 00000100:00100000:3.0:1784756078.892370:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190066816 00000100:00100000:3.0:1784756078.892410:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784756078.892418:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1871452190066816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756078.892458:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1871452190066816:12345-0@lo:400:kworker.0 Request processed in 41us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756078.892465:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1784756078.892485:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756078.892630:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bff9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190066304:0@lo:400:kworker.0 00000100:00100000:3.0:1784756078.892648:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1871452190066816:0@lo:400:kworker.0 10000000:01000000:0.0:1784756079.197970:0:5779:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784756079.197977:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96f1abd8c000 from 7 10000000:01000000:0.0:1784756079.197982:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784756079.198025:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f186aada00/0xbe94f39231c84fd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756079.198038:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f186aada00/0xbe94f39231c84fd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756079.198050:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f186aada00/0xbe94f39231c84fd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756079.198078:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf546680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784756079.198159:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756079.198215:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b53bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1784756079.198326:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190067072 00000100:00100000:2.0:1784756079.198334:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190067072 00000100:00100000:2.0:1784756079.198383:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1784756079.198393:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+16:5779:x1871452190067072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756079.198405:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756079.198418:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84fde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84fd7 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756079.198451:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84fde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84fd7 expref: 17 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756079.198470:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f1c21dca00/0xbe94f39231c84fde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84fd7 expref: 17 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756079.198480:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21dca00, rc 0) 00000100:00100000:2.0:1784756079.198531:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190067072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756079.198538:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1784756079.198596:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf546680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784756079.198610:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f186aada00/0xbe94f39231c84fd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fde expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756079.198619:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f186aada00/0xbe94f39231c84fd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84fde expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756079.198670:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756079.198696:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756079.198713:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1bc1b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1784756079.198727:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190067200 00000100:00100000:2.0:1784756079.198730:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190067200 00000100:00100000:2.0:1784756079.198752:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784756079.198758:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190067200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756079.199016:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190067200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756079.199023:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784756079.199055:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784756079.199093:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756079.199127:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756079.199141:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1bc1b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1784756079.199151:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190067328 00000100:00100000:2.0:1784756079.199154:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190067328 00000100:00100000:2.0:1784756079.199171:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1784756079.199176:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190067328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756079.199311:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190067328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756079.199317:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1784756079.199350:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784756079.209826:0:11397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784756079.210624:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784756079.210656:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784756079.210667:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f186aada00/0xbe94f39231c84fd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fde expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756079.210680:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f186aada00/0xbe94f39231c84fd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fde expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784756079.210691:0:5779:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784756079.210693:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96f1bc39f800 from 7 10000000:01000000:2.0:1784756079.210696:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784756079.210731:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84fe5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756079.210739:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84fe5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756079.210767:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84fe5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756079.210792:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784756079.210910:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756079.210959:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1bc1b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1784756079.210959:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190067456 00000100:00100000:1.0:1784756079.210965:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190067456 00000100:00100000:1.0:1784756079.211015:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1784756079.211024:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+17:5779:x1871452190067456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756079.211037:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756079.211051:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f185039200/0xbe94f39231c84fec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84fe5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756079.211072:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f185039200/0xbe94f39231c84fec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84fe5 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756079.211091:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f185039200/0xbe94f39231c84fec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84fe5 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756079.211099:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185039200, rc 0) 00000100:00100000:1.0:1784756079.211141:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190067456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756079.211148:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1784756079.211193:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756079.211206:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84fe5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fec expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756079.211215:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84fe5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84fec expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756079.211275:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b53da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756079.211312:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756079.211335:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f191a64900 going to sleep for 11 seconds 00000100:00100000:3.0:1784756079.211399:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190067584 00000100:00100000:3.0:1784756079.211404:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190067584 00000100:00100000:3.0:1784756079.211436:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784756079.211444:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190067584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756079.211679:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190067584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756079.211686:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784756079.211711:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b53da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756079.211738:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784756079.211772:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756079.211795:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186085600 going to sleep for 11 seconds 00000100:00100000:0.0:1784756079.211826:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190067712 00000100:00100000:0.0:1784756079.211849:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190067712 00000100:00100000:0.0:1784756079.211869:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1784756079.211881:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190067712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756079.212019:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190067712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756079.212031:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784756079.215321:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784756079.220226:0:11400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784756079.220725:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784756079.220748:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784756079.220759:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84fe5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fec expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756079.220771:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f1c21dc200/0xbe94f39231c84fe5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84fec expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784756079.220781:0:5779:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784756079.220784:0:5779:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96f18794d800 from 7 10000000:01000000:3.0:1784756079.220787:0:5779:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784756079.220824:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181500e00/0xbe94f39231c84ff3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756079.220845:0:5779:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.121@tcp lock: ffff96f181500e00/0xbe94f39231c84ff3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756079.220857:0:5779:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.121@tcp lock: ffff96f181500e00/0xbe94f39231c84ff3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756079.220913:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784756079.220975:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756079.221010:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186085cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756079.221411:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190067840 00000100:00100000:1.0:1784756079.221419:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190067840 00000100:00100000:1.0:1784756079.221500:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784756079.221509:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+18:5779:x1871452190067840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784756079.221523:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756079.221535:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96f185039c00/0xbe94f39231c84ffa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbe94f39231c84ff3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756079.221559:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96f185039c00/0xbe94f39231c84ffa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbe94f39231c84ff3 expref: 19 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756079.221576:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96f185039c00/0xbe94f39231c84ffa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbe94f39231c84ff3 expref: 19 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756079.221585:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185039c00, rc 0) 00000100:00100000:1.0:1784756079.221628:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190067840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756079.221635:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784756079.229364:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784756079.229395:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.121@tcp lock: ffff96f181500e00/0xbe94f39231c84ff3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84ffa expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756079.229408:0:5779:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.121@tcp lock: ffff96f181500e00/0xbe94f39231c84ff3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbe94f39231c84ffa expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756079.229485:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784756079.229557:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756079.229597:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f186085cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784756079.231853:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190067968 00000100:00100000:1.0:1784756079.231862:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190067968 00000100:00100000:1.0:1784756079.232182:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1784756079.232192:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190067968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784756079.232482:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190067968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756079.232492:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1784756079.232741:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc570000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190067968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784756079.232870:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf545500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190068096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784756079.232916:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756079.232949:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff96f1b53bca80 going to sleep for 11 seconds 00000100:00100000:2.0:1784756079.233187:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190068096 00000100:00100000:2.0:1784756079.233193:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190068096 00000100:00100000:2.0:1784756079.233228:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1784756079.233247:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190068096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784756079.233390:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:5779:x1871452190068096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756079.233397:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1784756079.233446:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf545500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f9117e42-6e26-4b4a-b619-3540b762413c:5779:1871452190068096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784756079.235299:0:11403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784756079.235376:0:5779:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784756079.235397:0:5779:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784756079.235408:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.121@tcp lock: ffff96f181500e00/0xbe94f39231c84ff3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84ffa expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756079.235419:0:5779:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.121@tcp lock: ffff96f181500e00/0xbe94f39231c84ff3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbe94f39231c84ffa expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756079.386150:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190068224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756079.386225:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756079.386314:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190068224 00000100:00100000:3.0:1784756079.386323:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190068224 00000100:00100000:3.0:1784756079.386384:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784756079.386394:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190068224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784756079.386438:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784756079.386484:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190068224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756079.386491:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1784756079.386533:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bf544700 x1871452190068224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756079.386561:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190068224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784756079.627240:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756079.627565:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170104320 00000100:00100000:3.0:1784756079.627576:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170104320 00000100:00100000:3.0:1784756079.627642:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 233 00000100:00100000:3.0:1784756079.627655:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170104320:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756079.627739:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2350:x1871452170104320:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 86us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756079.627747:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 233 00000100:00100000:3.0:1784756079.627808:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756079.628366:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170104448 00000100:00100000:3.0:1784756079.628371:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170104448 00000100:00100000:3.0:1784756079.628409:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 88 00000100:00100000:3.0:1784756079.628415:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170104448:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756079.628452:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170104448:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 37us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756079.628459:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 88 00000100:00080000:1.0:1784756079.628525:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756079.903621:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756080.921039:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756081.947516:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756081.986351:0:11550:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg421-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784756082.969802:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756082.970350:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784756082.970374:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190068352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756082.970450:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756082.970808:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190068352 00000100:00100000:0.0:1784756082.970816:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190068352 00000100:00100000:0.0:1784756082.971151:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784756082.971171:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190068352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784756082.971209:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756082.971273:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190068352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756082.971281:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1784756082.971602:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa19f80 x1871452190068352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756082.971621:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190068352:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784756082.975650:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784756083.996102:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756083.998569:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190068480:0@lo:400:kworker.0 00000100:00100000:3.0:1784756083.998670:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756083.998745:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1871452190068992:0@lo:400:kworker.0 00000100:00100000:3.0:1784756083.999133:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756083.999194:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784756083.999205:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190068864:0@lo:400:kworker.0 00000100:00100000:3.0:1784756083.999254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756083.999301:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190068608:0@lo:400:kworker.0 00000100:00100000:3.0:1784756083.999327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756083.999347:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190069120:0@lo:400:kworker.0 00000100:00100000:3.0:1784756083.999368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756083.999388:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756083.999394:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1871452190068736:0@lo:400:kworker.0 00000100:00100000:3.0:1784756083.999433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756083.999492:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190068992 00000100:00100000:3.0:1784756083.999515:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190068992 00000100:00100000:3.0:1784756083.999571:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190068608 00000100:00100000:3.0:1784756083.999574:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190068608 00000100:00100000:3.0:1784756083.999584:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190068736 00000100:00100000:3.0:1784756083.999586:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190068736 00000100:00100000:3.0:1784756083.999601:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784756083.999611:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1871452190068992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756083.999672:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1871452190068992:12345-0@lo:400:kworker.0 Request processed in 61us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756083.999679:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784756083.999696:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784756083.999702:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190068608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756083.999744:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190068608:12345-0@lo:400:kworker.0 Request processed in 41us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756083.999750:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784756084.000241:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190068480 00000100:00100000:2.0:1784756084.000247:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190068480 00000100:00100000:2.0:1784756084.000281:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784756084.000288:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3303:x1871452190068480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756084.000336:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3303:x1871452190068480:12345-0@lo:400:kworker.0 Request processed in 49us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756084.000343:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:2.0:1784756084.000398:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756084.000412:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784756084.000419:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1871452190068736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756084.000447:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1871452190068736:12345-0@lo:400:kworker.0 Request processed in 29us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756084.000453:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784756084.000474:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190068864 00000100:00100000:2.0:1784756084.000476:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190068864 00000100:00100000:2.0:1784756084.000516:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190069120 00000100:00100000:2.0:1784756084.000518:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190069120 00000100:00100000:2.0:1784756084.000540:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784756084.000545:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190068864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756084.000574:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190068864:12345-0@lo:400:kworker.0 Request processed in 29us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756084.000580:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784756084.000590:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784756084.000595:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190069120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756084.000617:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190069120:12345-0@lo:400:kworker.0 Request processed in 22us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756084.000635:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1784756084.000656:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784756084.000659:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784756084.001180:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa18e00 x1871452190068864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756084.001198:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190068864:0@lo:400:kworker.0 00000100:00100000:3.0:1784756084.001220:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190068480:0@lo:400:kworker.0 00000100:00100000:3.0:1784756084.001233:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1871452190068992:0@lo:400:kworker.0 00000100:00100000:3.0:1784756084.001275:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1871452190068736:0@lo:400:kworker.0 00000100:00100000:3.0:1784756084.001288:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190068608:0@lo:400:kworker.0 00010000:00080000:3.0:1784756084.001298:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa18a80 x1871452190069120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756084.001307:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190069120:0@lo:400:kworker.0 00000100:00100000:0.0:1784756084.510003:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784756084.510028:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190069248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756084.510096:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756084.510175:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190069248 00000100:00100000:0.0:1784756084.510183:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190069248 00000100:00100000:0.0:1784756084.510228:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784756084.510237:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190069248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756084.510270:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756084.510314:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190069248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756084.510345:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1784756084.510392:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bf547480 x1871452190069248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756084.510410:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190069248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784756084.755086:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756084.755146:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756084.755174:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170104704 00000100:00100000:2.0:1784756084.755184:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170104704 00000100:00100000:2.0:1784756084.755242:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 92 00000100:00100000:2.0:1784756084.755253:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170104704:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756084.755325:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170104704:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756084.755334:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 92 00000100:00100000:2.0:1784756084.755356:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170104576 00000100:00100000:2.0:1784756084.755359:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170104576 00000100:00100000:2.0:1784756084.755381:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 235 00000100:00100000:2.0:1784756084.755388:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170104576:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756084.755410:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170104576:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 23us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756084.755417:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 235 00000100:00080000:2.0:1784756084.755439:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756085.017206:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756086.056176:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756087.066095:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784756087.164582:0:11650:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 17:34:44 (1784756084) === 00000100:00100000:3.0:1784756087.358857:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756087.363643:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170104832 00000100:00100000:0.0:1784756087.363658:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170104832 00000100:00100000:0.0:1784756087.363740:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 10 00000100:00100000:0.0:1784756087.363751:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:7622:x1871452170104832:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1784756087.363773:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756087.363892:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d09 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.363962:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85008 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.363976:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.363989:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364024:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8500f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364032:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8500f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364038:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8500f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364431:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85008 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364440:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85008 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364447:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85008 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364454:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aaca00 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756087.364458:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85008 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364465:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85008 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364479:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097100) 00010000:00010000:0.0:1784756087.364482:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756087.364486:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364492:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364506:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8500f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364512:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8500f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364517:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8500f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364529:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aac800 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756087.364532:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8500f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364537:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8500f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364545:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff96f187e1bf00) 00010000:00010000:0.0:1784756087.364547:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756087.364549:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8500f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364554:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8500f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364588:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85001 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d09 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364597:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097100) 00010000:00010000:0.0:1784756087.364599:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784756087.364602:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d09 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.364610:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aad600, rc 0) 00000100:00100000:0.0:1784756087.364683:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:7622:x1871452170104832:12345-192.168.204.21@tcp:101:bash.0 Request processed in 935us (5856us total) trans 0 rc 301/301 00000100:00100000:0.0:1784756087.364691:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 10 00000100:00080000:3.0:1784756087.366446:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784756087.374178:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756087.374298:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170104960 00000100:00100000:0.0:1784756087.374319:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170104960 00000100:00100000:0.0:1784756087.374380:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 11 00000100:00100000:0.0:1784756087.374391:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:7622:x1871452170104960:12345-192.168.204.21@tcp:101:bash.0 00010000:00010000:0.0:1784756087.374412:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756087.374433:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aacc00/0xbe94f39231c85016 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d10 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374497:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8501d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374512:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8501d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374524:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8501d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374598:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85024 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374607:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374614:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374893:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8501d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374902:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8501d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374909:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8501d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374922:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aade00 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756087.374926:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8501d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374934:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8501d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374947:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097100) 00010000:00010000:0.0:1784756087.374950:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756087.374954:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8501d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374960:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8501d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374970:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85024 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374976:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85024 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374981:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85024 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374986:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aad400 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756087.374989:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85024 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.374994:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85024 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.375011:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff96f187e1b400) 00010000:00010000:0.0:1784756087.375014:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756087.375017:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85024 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.375022:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85024 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.375056:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aacc00/0xbe94f39231c85016 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d10 expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.375066:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097100) 00010000:00010000:0.0:1784756087.375068:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784756087.375072:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aacc00/0xbe94f39231c85016 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d10 expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.375096:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aacc00, rc 0) 00000100:00100000:0.0:1784756087.375154:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:7622:x1871452170104960:12345-192.168.204.21@tcp:101:bash.0 Request processed in 765us (985us total) trans 0 rc 301/301 00000100:00100000:0.0:1784756087.375161:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 11 00000100:00100000:3.0:1784756087.383147:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756087.384236:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170105088 00000100:00100000:1.0:1784756087.384253:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170105088 00000100:00100000:1.0:1784756087.384309:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1 00000100:00100000:1.0:1784756087.384325:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:7622:x1871452170105088:12345-192.168.204.21@tcp:37:bash.0 00000100:00100000:1.0:1784756087.390881:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:7622:x1871452170105088:12345-192.168.204.21@tcp:37:bash.0 Request processed in 6533us (7726us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756087.390897:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1 00000100:00100000:0.0:1784756087.410228:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756087.410678:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170105216 00000100:00100000:1.0:1784756087.410689:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170105216 00000100:00100000:1.0:1784756087.410741:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 12 00000100:00100000:1.0:1784756087.410752:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:10412:x1871452170105216:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:1.0:1784756087.410773:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756087.410794:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038c00/0xbe94f39231c8502b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d17 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.410877:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85032 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.410892:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85032 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.410904:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85032 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.410971:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85039 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.410979:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.410986:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411264:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85032 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411272:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85032 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411278:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85032 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411283:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f185038600 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:1.0:1784756087.411287:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85032 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411295:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85032 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411307:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097100) 00010000:00010000:1.0:1784756087.411310:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756087.411315:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85032 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411320:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411330:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85039 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411336:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85039 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411343:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85039 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411354:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f185038400 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:1.0:1784756087.411357:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85039 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411363:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85039 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411372:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff96f1a2097400) 00010000:00010000:1.0:1784756087.411374:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756087.411377:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85039 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411382:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85039 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411416:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038c00/0xbe94f39231c8502b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d17 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411426:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097100) 00010000:00010000:1.0:1784756087.411429:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756087.411432:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038c00/0xbe94f39231c8502b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d17 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.411441:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185038c00, rc 0) 00000100:00100000:1.0:1784756087.411503:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:10412:x1871452170105216:12345-192.168.204.21@tcp:101:rm.0 Request processed in 752us (1281us total) trans 0 rc 301/301 00000100:00100000:1.0:1784756087.411510:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 12 00000100:00100000:3.0:1784756087.504435:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756087.504506:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756087.504562:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170105344 00000100:00100000:3.0:1784756087.504575:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170105344 00000100:00100000:1.0:1784756087.504659:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170105472 00000100:00100000:3.0:1784756087.504661:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 13 00000100:00100000:3.0:1784756087.504674:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2347:x1871452170105344:12345-192.168.204.21@tcp:41:mkdir.0 00000100:00100000:1.0:1784756087.504687:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170105472 00000100:00100000:1.0:1784756087.504747:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 0 00000004:00000024:3.0:1784756087.504751:0:5783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784756087.504761:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:633fb912-5a65-4a74-b46a-ec98078e3827+7:10415:x1871452170105472:12345-192.168.204.21@tcp:700:mkdir.0 00000100:00100000:1.0:1784756087.504885:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:633fb912-5a65-4a74-b46a-ec98078e3827+7:10415:x1871452170105472:12345-192.168.204.21@tcp:700:mkdir.0 Request processed in 128us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756087.504893:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 0 00000100:00100000:3.0:1784756087.505087:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2347:x1871452170105344:12345-192.168.204.21@tcp:41:mkdir.0 Request processed in 404us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756087.505097:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 13 00000100:00100000:2.0:1784756087.511640:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756087.511783:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170105728 00000100:00100000:1.0:1784756087.511793:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170105728 00000100:00100000:1.0:1784756087.511888:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 14 00000100:00100000:1.0:1784756087.511898:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:10415:x1871452170105728:12345-192.168.204.21@tcp:36:mkdir.0 00010000:00010000:1.0:1784756087.511954:0:6601:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784756087.511982:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c84f13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1ce6 expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.512000:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097100) 00010000:00010000:1.0:1784756087.512010:0:6601:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784756087.512295:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85040 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.512309:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85040 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.512318:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85040 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.512384:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85047 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.512508:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85047 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.512523:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85047 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756087.516047:0:6601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784756087.516066:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85040 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.516088:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85040 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.516095:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85040 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.516100:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f185038400 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:1.0:1784756087.516104:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85040 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.516111:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85040 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.516129:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097400) 00010000:00010000:1.0:1784756087.516132:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756087.516137:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85040 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.516142:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85040 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784756087.516160:0:6601:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f3a8e27 reply state 0000000076916756 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85047 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756087.516180:0:6601:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784756087.516335:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+7:10415:x1871452170105728:12345-192.168.204.21@tcp:36:mkdir.0 Request processed in 4433us (4700us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784756087.516344:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 14 00010000:00010000:0.0:1784756087.527398:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85047 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.527415:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85047 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.527423:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85047 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.527442:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f185038600 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756087.527446:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85047 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.527453:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85047 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.527467:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96f1a2097c00) 00010000:00010000:0.0:1784756087.527470:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756087.527475:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85047 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.527481:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038600/0xbe94f39231c85047 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756087.569323:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756087.569643:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170105856 00000100:00100000:3.0:1784756087.569673:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170105856 00000100:00100000:3.0:1784756087.569758:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 15 00000100:00100000:3.0:1784756087.569770:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:10416:x1871452170105856:12345-192.168.204.21@tcp:101:chmod.0 00010000:00010000:3.0:1784756087.569800:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756087.569869:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8504e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d1e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.569970:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500000/0xbe94f39231c85055 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.569986:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500000/0xbe94f39231c85055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.570001:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500000/0xbe94f39231c85055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784756087.570090:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784756087.570095:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784756087.570159:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500000/0xbe94f39231c85055 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.570190:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8504e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d1e expref: 8 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.570213:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500000/0xbe94f39231c85055 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d1e expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.570223:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f186bd5100) 00010000:00010000:3.0:1784756087.570227:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784756087.570231:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f181500000, rc 0) 00000100:00100000:3.0:1784756087.572740:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+7:10416:x1871452170105856:12345-192.168.204.21@tcp:101:chmod.0 Request processed in 2956us (3416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756087.572758:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 15 00000100:00100000:1.0:1784756087.589090:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756087.593666:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170106112 00000100:00100000:2.0:1784756087.593682:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170106112 00000100:00100000:2.0:1784756087.593817:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 16 00000100:00100000:2.0:1784756087.593829:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+7:10416:x1871452170106112:12345-192.168.204.21@tcp:36:chmod.0 00010000:00010000:2.0:1784756087.593929:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756087.593960:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500000/0xbe94f39231c85055 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d1e expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.593982:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f186bd5100) 00010000:00010000:2.0:1784756087.593993:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784756087.594019:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8505c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.594032:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8505c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.594041:0:5781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8505c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784756087.594730:0:5781:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c96d6964 reply state 00000000695e62cf transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8505c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756087.594741:0:5781:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784756087.594756:0:5781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1784756087.594967:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+8:10416:x1871452170106112:12345-192.168.204.21@tcp:36:chmod.0 Request processed in 1138us (5893us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784756087.594975:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 16 00010000:00010000:2.0:1784756087.599271:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8505c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.599289:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8505c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.599297:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8505c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.599316:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21dc800 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:2.0:1784756087.599321:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8505c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.599329:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8505c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.599345:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1871f6500) 00010000:00010000:2.0:1784756087.599347:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784756087.599352:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8505c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.599358:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8505c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756087.702232:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756087.702339:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170106240 00000100:00100000:2.0:1784756087.702350:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170106240 00000100:00100000:2.0:1784756087.702417:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 17 00000100:00100000:2.0:1784756087.702427:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+7:10417:x1871452170106240:12345-192.168.204.21@tcp:101:chown.0 00010000:00010000:2.0:1784756087.702451:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784756087.702473:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c85063 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d25 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.702540:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21ddc00/0xbe94f39231c8506a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.702554:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21ddc00/0xbe94f39231c8506a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.702565:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21ddc00/0xbe94f39231c8506a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784756087.702637:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784756087.702641:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784756087.702682:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21ddc00/0xbe94f39231c8506a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.702707:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c85063 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d25 expref: 9 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.702729:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21ddc00/0xbe94f39231c8506a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d25 expref: 8 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.702738:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1871f6500) 00010000:00010000:2.0:1784756087.702741:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784756087.702744:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1c21ddc00, rc 0) 00000100:00100000:2.0:1784756087.702810:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+8:10417:x1871452170106240:12345-192.168.204.21@tcp:101:chown.0 Request processed in 384us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756087.702818:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 17 00000100:00100000:0.0:1784756087.707423:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756087.707498:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170106368 00000100:00100000:1.0:1784756087.707509:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170106368 00000100:00100000:1.0:1784756087.707567:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 18 00000100:00100000:1.0:1784756087.707577:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+8:10417:x1871452170106368:12345-192.168.204.21@tcp:101:chown.0 00010000:00010000:1.0:1784756087.707596:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756087.707616:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d2c expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707691:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c85078 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707706:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c85078 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707717:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c85078 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707730:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c8507f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707736:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c8507f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707760:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c8507f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707887:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038800/0xbe94f39231c85086 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707896:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038800/0xbe94f39231c85086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707903:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038800/0xbe94f39231c85086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756087.707941:0:6601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1784756087.707946:0:6601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784756087.707972:0:6601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038800/0xbe94f39231c85086 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707983:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c85078 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707989:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c85078 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.707996:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c85078 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708001:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f185038a00 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:1.0:1784756087.708005:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c85078 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708012:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c85078 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708031:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1871f6500) 00010000:00010000:1.0:1784756087.708034:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756087.708039:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c85078 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708044:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038a00/0xbe94f39231c85078 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708056:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c8507f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708062:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c8507f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708067:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c8507f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708082:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f185038e00 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:1.0:1784756087.708085:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c8507f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708090:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c8507f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708097:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96f1a2097400) 00010000:00010000:1.0:1784756087.708099:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756087.708101:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c8507f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708106:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c8507f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708147:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d2c expref: 10 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708159:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038800/0xbe94f39231c85086 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d2c expref: 9 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.708167:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f1a2097100) 00010000:00010000:1.0:1784756087.708169:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784756087.708171:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185038800, rc 0) 00000100:00100000:1.0:1784756087.708237:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+9:10417:x1871452170106368:12345-192.168.204.21@tcp:101:chown.0 Request processed in 660us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756087.708245:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 18 00000100:00100000:0.0:1784756087.712045:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756087.712140:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170106624 00000100:00100000:2.0:1784756087.712148:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170106624 00000100:00100000:2.0:1784756087.712205:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 19 00000100:00100000:2.0:1784756087.712214:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+9:10417:x1871452170106624:12345-192.168.204.21@tcp:36:chown.0 00010000:00010000:2.0:1784756087.712261:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784756087.712284:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038800/0xbe94f39231c85086 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d2c expref: 9 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.712304:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f1a2097100) 00010000:00010000:2.0:1784756087.712327:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784756087.712355:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8508d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.712367:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8508d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.712377:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8508d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784756087.817293:0:5804:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1784756087.817311:0:5804:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1784756087.817685:0:5782:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000181ae8c0 reply state 000000007af6f581 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8508d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756087.817700:0:5782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784756087.818677:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1784756087.818795:0:5782:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1784756087.818822:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+7:10417:x1871452170106624:12345-192.168.204.21@tcp:36:chown.0 Request processed in 106604us (106781us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784756087.818858:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 19 00010000:00010000:1.0:1784756087.820525:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8508d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.820540:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8508d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.820560:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8508d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.820567:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21dc800 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:1.0:1784756087.820572:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8508d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.820580:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8508d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.820608:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f1871f6700) 00010000:00010000:1.0:1784756087.820611:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784756087.820616:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8508d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756087.820623:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dc800/0xbe94f39231c8508d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756087.861513:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756087.863252:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170106752 00000100:00100000:1.0:1784756087.863266:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170106752 00000100:00100000:1.0:1784756087.863341:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 20 00000100:00100000:1.0:1784756087.863352:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:10418:x1871452170106752:12345-192.168.204.21@tcp:101:touch.500 00010000:00010000:1.0:1784756087.863376:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756087.863397:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85094 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d33 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784756087.866575:0:6601:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3128us 00010000:00010000:3.0:1784756087.903807:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8509b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.903861:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8509b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.903877:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8509b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.903900:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.903907:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.903914:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904354:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c850a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904363:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c850a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904370:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c850a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784756087.904441:0:6601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784756087.904445:0:6601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784756087.904533:0:6601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c850a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904552:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8509b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904558:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8509b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904564:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8509b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904569:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181500800 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:3.0:1784756087.904573:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8509b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904580:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8509b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904591:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1871f6500) 00010000:00010000:3.0:1784756087.904594:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756087.904599:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8509b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904605:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c8509b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904618:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904623:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904629:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904640:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181501200 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:3.0:1784756087.904643:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904649:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904658:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96f186bd5a00) 00010000:00010000:3.0:1784756087.904660:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756087.904663:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904669:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904707:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038400/0xbe94f39231c85094 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d33 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904722:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c850a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d33 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.904729:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f186bd5f00) 00010000:00010000:3.0:1784756087.904730:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784756087.904732:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f181500400, rc 0) 00000100:00100000:3.0:1784756087.904805:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+7:10418:x1871452170106752:12345-192.168.204.21@tcp:101:touch.500 Request processed in 41453us (43299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756087.904813:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 20 00000100:00100000:3.0:1784756087.920804:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756087.921035:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170107008 00000100:00100000:0.0:1784756087.921047:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170107008 00000100:00100000:0.0:1784756087.921111:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 21 00000100:00100000:0.0:1784756087.921121:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+7:10418:x1871452170107008:12345-192.168.204.21@tcp:101:touch.500 00010000:00010000:0.0:1784756087.921143:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756087.921165:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d3a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.921476:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.921497:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.921508:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.921575:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c850be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.921583:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c850be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.921591:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c850be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784756087.922454:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1784756087.922730:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c850c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.922743:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c850c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.922752:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c850c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.922785:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.922793:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.922799:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.922812:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aaca00 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756087.922816:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.922823:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.922860:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f186bd5f00) 00010000:00010000:0.0:1784756087.922864:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756087.922869:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.922875:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784756087.922891:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000559779af reply state 00000000220fc13b transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c850be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756087.922899:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784756087.922930:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d3a expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.922944:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c850c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d3a expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.922951:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96f187e1b400) 00010000:00010000:0.0:1784756087.922954:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784756087.922956:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aac200, rc 0) 00000100:00100000:0.0:1784756087.923033:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+10:10418:x1871452170107008:12345-192.168.204.21@tcp:101:touch.500 Request processed in 1912us (2237us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784756087.923047:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 21 00000100:00100000:1.0:1784756087.936171:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756087.937261:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170107264 00000100:00100000:0.0:1784756087.937274:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170107264 00000100:00100000:0.0:1784756087.937341:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 22 00000100:00100000:0.0:1784756087.937353:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+10:10418:x1871452170107264:12345-192.168.204.21@tcp:36:touch.500 00010000:00010000:0.0:1784756087.937418:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756087.937444:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c850c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d3a expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.937461:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96f187e1b400) 00010000:00010000:0.0:1784756087.937470:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784756087.937522:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.937536:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.937546:0:5781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.938395:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c850be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.938406:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c850be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.938414:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c850be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.938420:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aad800 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:2.0:1784756087.938425:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c850be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.938454:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c850be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.938465:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff96f187e1bf00) 00010000:00010000:2.0:1784756087.938468:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756087.938472:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c850be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756087.938479:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c850be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784756087.938650:0:5781:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b61e6330 reply state 000000006889ef2f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756087.938661:0:5781:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784756087.939035:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+10:10418:x1871452170107264:12345-192.168.204.21@tcp:36:touch.500 Request processed in 1682us (2872us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1784756087.939043:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 22 00000100:00100000:1.0:1784756087.947076:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00010000:00010000:0.0:1784756087.947149:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.947187:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.947197:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.947204:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aac800 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756087.947209:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.947217:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.947234:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96f187e1b000) 00010000:00010000:0.0:1784756087.947237:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756087.947242:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756087.947249:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c850d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756087.948349:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170107392 00000100:00100000:3.0:1784756087.948360:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170107392 00000100:00100000:3.0:1784756087.948429:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 23 00000100:00100000:3.0:1784756087.948438:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b53dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+9:10418:x1871452170107392:12345-192.168.204.21@tcp:101:touch.500 00010000:00010000:3.0:1784756087.948471:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756087.948498:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d41 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.948557:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d41 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.948571:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d41 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756087.948589:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96f186bd5a00) 00010000:00010000:3.0:1784756087.948592:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784756087.948595:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f181501200, rc 0) 00000100:00100000:3.0:1784756087.949046:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b53dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+10:10418:x1871452170107392:12345-192.168.204.21@tcp:101:touch.500 Request processed in 606us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756087.949055:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 23 00000100:00100000:1.0:1784756087.953590:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756087.954001:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170107520 00000100:00100000:3.0:1784756087.954012:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170107520 00000100:00100000:3.0:1784756087.954060:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 12 00000100:00100000:3.0:1784756087.954079:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1871452170107520:12345-192.168.204.21@tcp:8:touch.500 00010000:00080000:3.0:1784756087.954112:0:6579:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 633fb912-5a65-4a74-b46a-ec98078e3827@192.168.204.21@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1784756087.954142:0:6579:0:(genops.c:1406:class_connect()) connect: client 633fb912-5a65-4a74-b46a-ec98078e3827, cookie 0xbe94f39231c850e1 00002000:00100000:3.0:1784756087.954153:0:6579:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 633fb912-5a65-4a74-b46a-ec98078e3827/ffff96f1bc59b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784756087.954198:0:6579:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784756087.954455:0:6579:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784756087.957105:0:6579:0:(import.c:65:import_set_state_nolock()) ffff96f1bf5a6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784756087.957269:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:2346:x1871452170107520:12345-192.168.204.21@tcp:8:touch.500 Request processed in 3186us (3683us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756087.957281:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 12 00000100:00100000:1.0:1784756087.979407:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756087.979598:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170107648 00000100:00100000:3.0:1784756087.979607:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170107648 00000100:00080000:2.0:1784756087.979869:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784756087.980293:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 13 00000100:00100000:3.0:1784756087.980306:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:633fb912-5a65-4a74-b46a-ec98078e3827+6:0:x1871452170107648:12345-192.168.204.21@tcp:2:touch.500 00000100:00100000:0.0:1784756088.073290:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:633fb912-5a65-4a74-b46a-ec98078e3827+7:0:x1871452170107648:12345-192.168.204.21@tcp:2:touch.500 Request processed in 92976us (93882us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784756088.073304:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 13 00000001:00080000:1.0:1784756088.075315:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1784756088.075331:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 633fb912-5a65-4a74-b46a-ec98078e3827 00000100:00100000:1.0:1784756088.082511:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756088.082957:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170107904 00000100:00100000:3.0:1784756088.082967:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170107904 00000100:00100000:3.0:1784756088.083028:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2 00000100:00100000:3.0:1784756088.083038:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:633fb912-5a65-4a74-b46a-ec98078e3827+10:10418:x1871452170107904:12345-192.168.204.21@tcp:35:touch.500 00000100:00100000:3.0:1784756088.083402:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:633fb912-5a65-4a74-b46a-ec98078e3827+11:10418:x1871452170107904:12345-192.168.204.21@tcp:35:touch.500 Request processed in 365us (899us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784756088.083409:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2 00010000:00010000:1.0:1784756088.090859:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756088.091820:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756088.091859:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190069376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756088.091943:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756088.092254:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190069376 00000100:00100000:1.0:1784756088.092261:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190069376 00000100:00100000:1.0:1784756088.092320:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784756088.092330:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190069376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756088.092394:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756088.092453:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190069376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756088.092460:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1784756088.092741:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa19500 x1871452190069376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756088.092760:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190069376:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784756088.094327:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784756088.110527:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756088.110677:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170108032 00000100:00100000:0.0:1784756088.110686:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170108032 00000100:00100000:0.0:1784756088.110755:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 24 00000100:00100000:0.0:1784756088.110766:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+11:10419:x1871452170108032:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:0.0:1784756088.110802:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756088.110823:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c850e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d48 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.110934:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.110948:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.110961:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756088.111019:0:6601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784756088.111023:0:6601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784756088.111074:0:6601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.111101:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c850e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d48 expref: 13 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.111120:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d48 expref: 12 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.111128:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f186bd5f00) 00010000:00010000:0.0:1784756088.111131:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784756088.111134:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aaca00, rc 0) 00000100:00100000:0.0:1784756088.111185:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+12:10419:x1871452170108032:12345-192.168.204.21@tcp:101:rm.0 Request processed in 420us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756088.111198:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 24 00000100:00100000:0.0:1784756088.117153:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756088.117650:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170108288 00000100:00100000:3.0:1784756088.117661:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170108288 00000100:00100000:3.0:1784756088.117728:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 25 00000100:00100000:3.0:1784756088.117739:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+12:10419:x1871452170108288:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:3.0:1784756088.117760:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756088.117790:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c850f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d4f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784756088.118404:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1784756088.118787:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c850f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d4f expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756088.118804:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1871f6500) 00010000:00010000:3.0:1784756088.118807:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784756088.118812:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c850f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d4f expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756088.118828:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f181500800, rc 0) 00000100:00100000:3.0:1784756088.119127:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+13:10419:x1871452170108288:12345-192.168.204.21@tcp:101:rm.0 Request processed in 1389us (1983us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1784756088.119135:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 25 00000100:00100000:1.0:1784756088.146313:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756088.146409:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170108416 00000100:00100000:3.0:1784756088.146420:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170108416 00000100:00100000:3.0:1784756088.146480:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3 00000100:00100000:3.0:1784756088.146491:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:633fb912-5a65-4a74-b46a-ec98078e3827+13:10419:x1871452170108416:12345-192.168.204.21@tcp:37:rm.0 00000100:00100000:0.0:1784756088.157597:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:633fb912-5a65-4a74-b46a-ec98078e3827+13:10419:x1871452170108416:12345-192.168.204.21@tcp:37:rm.0 Request processed in 11099us (11285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756088.157610:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3 00000100:00100000:0.0:1784756088.171150:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756088.171240:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170108672 00000100:00100000:1.0:1784756088.171251:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170108672 00000100:00100000:1.0:1784756088.171306:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 4 00000100:00100000:1.0:1784756088.171318:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f19778c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:633fb912-5a65-4a74-b46a-ec98078e3827+13:10419:x1871452170108672:12345-192.168.204.21@tcp:35:rm.0 00000100:00100000:1.0:1784756088.171587:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f19778c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:633fb912-5a65-4a74-b46a-ec98078e3827+14:10419:x1871452170108672:12345-192.168.204.21@tcp:35:rm.0 Request processed in 270us (445us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784756088.171594:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 4 00000100:00100000:1.0:1784756088.181123:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756088.181227:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170108928 00000100:00100000:0.0:1784756088.181247:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170108928 00000100:00100000:0.0:1784756088.181311:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 26 00000100:00100000:0.0:1784756088.181321:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+14:10419:x1871452170108928:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:0.0:1784756088.181345:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756088.181366:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aadc00/0xbe94f39231c85104 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d56 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.181498:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c8510b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.181512:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c8510b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.181523:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c8510b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756088.181534:0:6601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1784756088.181668:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aadc00/0xbe94f39231c85104 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d56 expref: 17 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.181699:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c8510b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d56 expref: 16 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.181718:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f186bd5f00) 00010000:00010000:0.0:1784756088.181721:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784756088.181724:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aad200, rc 0) 00000100:00100000:0.0:1784756088.181791:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+16:10419:x1871452170108928:12345-192.168.204.21@tcp:101:rm.0 Request processed in 470us (678us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1784756088.181798:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 26 00000100:00100000:3.0:1784756088.201737:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756088.201933:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170109056 00000100:00100000:0.0:1784756088.201943:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170109056 00000100:00100000:0.0:1784756088.202003:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 27 00000100:00100000:0.0:1784756088.202014:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+16:10419:x1871452170109056:12345-192.168.204.21@tcp:41:rm.0 00000004:00000024:0.0:1784756088.202089:0:5782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1784756088.202162:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+16:10419:x1871452170109056:12345-192.168.204.21@tcp:41:rm.0 Request processed in 150us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756088.202169:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 27 00000100:00100000:1.0:1784756088.208082:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756088.208356:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170109184 00000100:00100000:0.0:1784756088.208366:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170109184 00000100:00100000:0.0:1784756088.208433:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 28 00000100:00100000:0.0:1784756088.208443:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+16:10419:x1871452170109184:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:0.0:1784756088.208464:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756088.208485:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aadc00/0xbe94f39231c85119 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d5d expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208551:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85120 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208566:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85120 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208591:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85120 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208607:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c85127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208615:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c85127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208621:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c85127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208747:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c8512e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208756:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c8512e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208764:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c8512e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756088.208790:0:6601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784756088.208794:0:6601:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784756088.208811:0:6601:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c8512e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208824:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c8512e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208880:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85120 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208898:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85120 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208904:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85120 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208909:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aac200 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756088.208913:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85120 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208920:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85120 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208930:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f186bd5f00) 00010000:00010000:0.0:1784756088.208933:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756088.208937:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85120 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208943:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85120 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208958:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c85127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208963:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c85127 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208968:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c85127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208972:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aac800 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756088.208981:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c85127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208987:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c85127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.208995:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff96f187e1b000) 00010000:00010000:0.0:1784756088.208997:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756088.209001:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c85127 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.209006:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c85127 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.209035:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aadc00/0xbe94f39231c85119 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d5d expref: 18 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.209047:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c8512e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d5d expref: 17 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.209054:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96f186bd5a00) 00010000:00010000:0.0:1784756088.209057:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784756088.209069:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aad800, rc 0) 00000100:00100000:0.0:1784756088.209131:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+17:10419:x1871452170109184:12345-192.168.204.21@tcp:101:rm.0 Request processed in 689us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756088.209139:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 28 00000100:00100000:1.0:1784756088.220239:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756088.220923:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170109440 00000100:00100000:0.0:1784756088.220933:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170109440 00000100:00100000:0.0:1784756088.220984:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 29 00000100:00100000:0.0:1784756088.220993:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+17:10419:x1871452170109440:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1784756088.221057:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784756088.221095:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c8512e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d5d expref: 17 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.221115:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c850da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d41 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.221126:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96f186bd5a00) 00010000:00010000:0.0:1784756088.221139:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c850ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d48 expref: 15 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.221149:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f186bd5f00) 00010000:00010000:0.0:1784756088.221151:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784756088.221480:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85135 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.221496:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85135 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.221507:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85135 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.221523:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8513c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.221531:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8513c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.221537:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8513c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.223617:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85143 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.223632:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85143 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.224653:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85143 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784756088.228399:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1784756088.228415:0:5782:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 268394580606ns, next at 269394577541ns, rc = 0 00010000:00010000:2.0:1784756088.228491:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dd800/0xbe94f39231c8514a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228509:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dd800/0xbe94f39231c8514a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228521:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dd800/0xbe94f39231c8514a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228529:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dd800/0xbe94f39231c8514a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228535:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dd800/0xbe94f39231c8514a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228542:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dd800/0xbe94f39231c8514a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228570:0:5782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784756088.228599:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85143 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228605:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85143 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228611:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85143 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228617:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aad400 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:2.0:1784756088.228621:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85143 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228628:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85143 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228640:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96f187e1b100) 00010000:00010000:2.0:1784756088.228643:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784756088.228647:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85143 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228652:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad400/0xbe94f39231c85143 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228670:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85135 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228690:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85135 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228696:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85135 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228707:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aad600 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:2.0:1784756088.228710:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85135 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228717:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85135 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228725:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f186bd5f00) 00010000:00010000:2.0:1784756088.228728:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756088.228731:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85135 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.228737:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad600/0xbe94f39231c85135 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784756088.228749:0:5782:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea50ecbc reply state 00000000bc758a2c transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8513c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756088.228758:0:5782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784756088.228873:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+16:10419:x1871452170109440:12345-192.168.204.21@tcp:36:rm.0 Request processed in 7876us (8638us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784756088.228881:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 29 00010000:00010000:1.0:1784756088.229600:0:11354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756088.229607:0:11354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dd800/0xbe94f39231c8514a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.229614:0:11354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1c21dd800 already unused, calling callback (ffffffffc1436230) 00010000:00010000:1.0:1784756088.229617:0:11354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dd800/0xbe94f39231c8514a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.229623:0:11354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dd800/0xbe94f39231c8514a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.229634:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff96f187e1b100) 00010000:00010000:1.0:1784756088.229653:0:11354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784756088.229657:0:11354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dd800/0xbe94f39231c8514a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.229664:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21dd800/0xbe94f39231c8514a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.229691:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756088.229693:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756088.229695:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784756088.244366:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8513c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.244393:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8513c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.244400:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8513c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.244424:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aade00 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:2.0:1784756088.244428:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8513c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.244435:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8513c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.244452:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff96f187e1b400) 00010000:00010000:2.0:1784756088.244455:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756088.244459:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8513c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756088.244464:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aade00/0xbe94f39231c8513c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756088.254481:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756088.254766:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170109696 00000100:00100000:3.0:1784756088.254777:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170109696 00000100:00100000:3.0:1784756088.254862:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5 00000100:00100000:3.0:1784756088.254889:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:633fb912-5a65-4a74-b46a-ec98078e3827+15:10419:x1871452170109696:12345-192.168.204.21@tcp:35:rm.0 00000100:00100000:3.0:1784756088.255139:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:633fb912-5a65-4a74-b46a-ec98078e3827+16:10419:x1871452170109696:12345-192.168.204.21@tcp:35:rm.0 Request processed in 253us (666us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1784756088.255162:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 5 00000100:00100000:3.0:1784756088.266088:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756088.266720:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170109952 00000100:00100000:0.0:1784756088.266731:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170109952 00000100:00100000:0.0:1784756088.266797:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 30 00000100:00100000:0.0:1784756088.266807:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+16:10419:x1871452170109952:12345-192.168.204.21@tcp:36:rm.0 00010000:00010000:0.0:1784756088.266912:0:6601:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784756088.266940:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c8510b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d56 expref: 16 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.266962:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c850a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d33 expref: 15 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.266974:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f186bd5f00) 00010000:00010000:0.0:1784756088.266990:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f1c21ddc00/0xbe94f39231c8506a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d25 expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.267005:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1871f6500) 00010000:00010000:0.0:1784756088.267012:0:6601:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784756088.267038:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85151 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.267075:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85151 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.267085:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85151 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.267099:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c85158 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.267106:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c85158 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.267112:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c85158 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.267784:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8515f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.267793:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8515f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.267801:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8515f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756088.290736:0:6601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1784756088.290761:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8515f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.290771:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8515f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.290778:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8515f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.290784:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aac800 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:1.0:1784756088.290789:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8515f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.290796:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8515f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.290811:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff96f187e1b300) 00010000:00010000:1.0:1784756088.290814:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784756088.290818:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8515f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.290950:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac800/0xbe94f39231c8515f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.290981:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85151 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.290987:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85151 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.290991:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85151 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.290996:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aaca00 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:1.0:1784756088.290999:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85151 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.291005:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85151 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.291013:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f187e1b000) 00010000:00010000:1.0:1784756088.291015:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784756088.291018:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85151 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756088.291023:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c85151 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784756088.291034:0:6601:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b7bd8d62 reply state 00000000c0dcdaf7 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c85158 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756088.291042:0:6601:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784756088.291151:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+15:10419:x1871452170109952:12345-192.168.204.21@tcp:36:rm.0 Request processed in 24341us (25068us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1784756088.291160:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 30 00010000:00010000:0.0:1784756088.293758:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c85158 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.293772:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c85158 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.293780:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c85158 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.293802:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aad800 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756088.293806:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c85158 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.293813:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c85158 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.293826:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff96f187e1b200) 00010000:00010000:0.0:1784756088.293829:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756088.294032:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c85158 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756088.294040:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c85158 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756089.112998:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756089.114243:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1871452190069760:0@lo:400:kworker.0 00000100:00100000:0.0:1784756089.114313:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756089.114376:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784756089.114382:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190069632:0@lo:400:kworker.0 00000100:00100000:0.0:1784756089.114406:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756089.114421:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190070144:0@lo:400:kworker.0 00000100:00100000:0.0:1784756089.114444:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756089.114481:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190070144 00000100:00100000:0.0:1784756089.114489:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190070144 00000100:00100000:0.0:1784756089.114541:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784756089.114552:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190070144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756089.114603:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190070144:12345-0@lo:400:kworker.0 Request processed in 53us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756089.114623:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1784756089.114668:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc581180 x1871452190070144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784756089.114682:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190070144:0@lo:400:kworker.0 00000100:00100000:3.0:1784756089.114760:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190069504:0@lo:400:kworker.0 00000100:00100000:3.0:1784756089.114794:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756089.114826:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1871452190070016:0@lo:400:kworker.0 00000100:00100000:3.0:1784756089.114884:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756089.114902:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784756089.114907:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bf545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190069888:0@lo:400:kworker.0 00000100:00100000:3.0:1784756089.114929:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784756089.115109:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784756089.115121:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190069760 00000100:00100000:2.0:1784756089.115126:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190069760 00000100:00100000:2.0:1784756089.115162:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190069632 00000100:00100000:2.0:1784756089.115165:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190069632 00000100:00100000:2.0:1784756089.115177:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190070016 00000100:00100000:2.0:1784756089.115180:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190070016 00000100:00100000:2.0:1784756089.115193:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784756089.115198:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1871452190069760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756089.115245:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1871452190069760:12345-0@lo:400:kworker.0 Request processed in 46us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756089.115251:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784756089.115263:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784756089.115268:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190069632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756089.115308:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190069632:12345-0@lo:400:kworker.0 Request processed in 39us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756089.115313:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784756089.115325:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784756089.115331:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1871452190070016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756089.115363:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1871452190070016:12345-0@lo:400:kworker.0 Request processed in 32us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756089.115369:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784756089.115394:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1871452190070016:0@lo:400:kworker.0 00000100:00100000:2.0:1784756089.115417:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf546a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190069632:0@lo:400:kworker.0 00000100:00100000:2.0:1784756089.115426:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1871452190069760:0@lo:400:kworker.0 00000100:00100000:1.0:1784756089.115557:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190069888 00000100:00100000:1.0:1784756089.115562:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190069888 00000100:00100000:1.0:1784756089.115589:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784756089.115595:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190069888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756089.115636:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190069888:12345-0@lo:400:kworker.0 Request processed in 41us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756089.115642:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1784756089.115670:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bf545180 x1871452190069888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756089.115680:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190069888:0@lo:400:kworker.0 00000100:00080000:3.0:1784756089.115892:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756089.116212:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190069504 00000100:00100000:0.0:1784756089.116218:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190069504 00000100:00100000:0.0:1784756089.116254:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1784756089.116262:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3303:x1871452190069504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756089.116309:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3303:x1871452190069504:12345-0@lo:400:kworker.0 Request processed in 48us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756089.116317:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1784756089.116405:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bf546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f9117e42-6e26-4b4a-b619-3540b762413c:3303:1871452190069504:0@lo:400:kworker.0 00000004:00080000:0.0:1784756089.627310:0:7846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 269793473322ns, next at 270793471054ns, rc = 0 00000100:00100000:3.0:1784756089.627368:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784756089.627390:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190070272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756089.627471:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756089.627644:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190070272 00000100:00100000:1.0:1784756089.627652:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190070272 00000100:00100000:1.0:1784756089.627696:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784756089.627706:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190070272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784756089.627739:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756089.627794:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1871452190070272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756089.627801:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1784756089.628173:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc581180 x1871452190070272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756089.628190:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190070272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756089.867253:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756089.867299:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756089.867340:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756089.867733:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170110336 00000100:00100000:1.0:1784756089.867743:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170110336 00000100:00100000:1.0:1784756089.867813:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 53 00000100:00100000:1.0:1784756089.867822:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:633fb912-5a65-4a74-b46a-ec98078e3827+5:2348:x1871452170110336:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756089.867949:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:633fb912-5a65-4a74-b46a-ec98078e3827+5:2348:x1871452170110336:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 128us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756089.867956:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 53 00000100:00100000:2.0:1784756089.868136:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170110208 00000100:00100000:2.0:1784756089.868151:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170110208 00000100:00100000:2.0:1784756089.868193:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 96 00000100:00100000:2.0:1784756089.868200:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+14:2348:x1871452170110208:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756089.868236:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+14:2348:x1871452170110208:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 36us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756089.868242:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 96 00000100:00100000:0.0:1784756089.868624:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170110080 00000100:00100000:0.0:1784756089.868629:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170110080 00000100:00100000:0.0:1784756089.868667:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 237 00000100:00100000:0.0:1784756089.868674:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170110080:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1784756089.868707:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170110080:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 33us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756089.868725:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 237 00000100:00080000:3.0:1784756089.868998:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784756089.869004:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784756090.137391:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756091.161254:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756092.186557:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756093.209384:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784756093.209637:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190070400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784756093.209716:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756093.209982:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190070400 00000100:00100000:2.0:1784756093.209991:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190070400 00000100:00100000:2.0:1784756093.210063:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784756093.210073:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190070400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784756093.210116:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756093.210177:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190070400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756093.210198:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1784756093.210250:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa1bb80 x1871452190070400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784756093.210270:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190070400:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784756093.211788:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1784756093.284004:0:5804:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1784756093.284036:0:5804:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1784756093.284055:0:5804:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1784756093.286729:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190070528:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784756093.286823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756093.287200:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190070528 00000100:00100000:1.0:1784756093.287210:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190070528 00000100:00100000:1.0:1784756093.287279:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784756093.287289:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190070528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784756093.287316:0:8479:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1784756093.287350:0:8479:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a613777, atime: 0x6a613777, ctime: 0x6a613777, blocks: 0x1 00010000:00010000:1.0:1784756093.287359:0:8479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a57e1874/0xbe94f39231c85166 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756093.287375:0:8479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=273s v=(0 0) 00010000:00010000:1.0:1784756093.287380:0:8479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756093.287387:0:8479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a57e1874/0xbe94f39231c85166 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756093.287404:0:8479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a57e1874/0xbe94f39231c85166 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756093.287413:0:8479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a57e1874/0xbe94f39231c85166 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756093.287421:0:8479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a57e1874/0xbe94f39231c85166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756093.287444:0:8479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784756093.287983:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1871452190070528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 694us (1165us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784756093.287993:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1784756093.288020:0:11354:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784756093.288027:0:11354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a57e1874/0xbe94f39231c85166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756093.288035:0:11354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f185038200 already unused, calling callback (ffffffffc1436230) 00010000:00010000:1.0:1784756093.288039:0:11354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a57e1874/0xbe94f39231c85166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756093.288048:0:11354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a57e1874/0xbe94f39231c85166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756093.288066:0:11354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a57e1874/0xbe94f39231c85166 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756093.288073:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a57e1874/0xbe94f39231c85166 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756093.288091:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756093.288092:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756093.288094:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784756093.288403:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff96f1bc1bf100/2, rc 0, transno 4294967300 00000100:00100000:3.0:1784756093.288411:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190070528:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1784756093.290304:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784756094.233042:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756094.233188:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190070912:0@lo:400:kworker.0 00000100:00100000:3.0:1784756094.233256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756094.233330:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756094.233337:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190071040:0@lo:400:kworker.0 00000100:00100000:3.0:1784756094.233363:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756094.233399:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190071040 00000100:00100000:3.0:1784756094.233407:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190071040 00000100:00100000:3.0:1784756094.233457:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784756094.233477:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190071040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756094.233550:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190071040:12345-0@lo:400:kworker.0 Request processed in 83us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756094.233557:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1784756094.233605:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1ae1dfb80 x1871452190071040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784756094.233622:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190071040:0@lo:400:kworker.0 00000100:00100000:2.0:1784756094.233762:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190070656:0@lo:400:kworker.0 00000100:00100000:2.0:1784756094.233829:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756094.233889:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190071168:0@lo:400:kworker.0 00000100:00100000:2.0:1784756094.233913:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756094.233934:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784756094.233940:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190070784:0@lo:400:kworker.0 00000100:00100000:2.0:1784756094.233974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756094.233995:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190071296:0@lo:400:kworker.0 00000100:00100000:2.0:1784756094.234016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756094.234042:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190070912 00000100:00100000:2.0:1784756094.234046:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190070912 00000100:00100000:2.0:1784756094.234081:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190071168 00000100:00100000:2.0:1784756094.234084:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190071168 00000100:00100000:2.0:1784756094.234096:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190070784 00000100:00100000:2.0:1784756094.234099:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190070784 00000100:00100000:2.0:1784756094.234110:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784756094.234117:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190070912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756094.234154:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190070912:12345-0@lo:400:kworker.0 Request processed in 38us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756094.234179:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784756094.234193:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784756094.234199:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190071168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756094.234233:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190071168:12345-0@lo:400:kworker.0 Request processed in 34us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756094.234239:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784756094.234249:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784756094.234254:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190070784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756094.234280:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1871452190070784:12345-0@lo:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756094.234285:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1784756094.234300:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784756094.234320:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1871452190070784:0@lo:400:kworker.0 00000100:00100000:2.0:1784756094.234330:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190071168:0@lo:400:kworker.0 00000100:00100000:1.0:1784756094.234489:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190071296 00000100:00100000:1.0:1784756094.234494:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190071296 00000100:00100000:1.0:1784756094.234548:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784756094.234556:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1871452190071296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756094.234598:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1871452190071296:12345-0@lo:400:kworker.0 Request processed in 43us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756094.234604:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784756094.234632:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1871452190071296:0@lo:400:kworker.0 00000100:00100000:3.0:1784756094.234770:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190070656 00000100:00100000:3.0:1784756094.234774:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190070656 00000100:00100000:3.0:1784756094.234810:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784756094.234817:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190070656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756094.234874:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190070656:12345-0@lo:400:kworker.0 Request processed in 57us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756094.234880:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784756094.234917:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190070912:0@lo:400:kworker.0 00000100:00100000:1.0:1784756094.235205:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190070656:0@lo:400:kworker.0 00000100:00100000:0.0:1784756094.745343:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784756094.745383:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190071424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756094.745511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756094.746354:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190071424 00000100:00100000:2.0:1784756094.746370:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190071424 00000100:00100000:2.0:1784756094.746433:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784756094.746444:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1871452190071424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756094.746488:0:6584:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756094.746598:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1871452190071424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756094.746606:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784756094.747483:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190071424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756094.983286:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756094.983356:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756094.983393:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756094.983478:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170110464 00000100:00100000:0.0:1784756094.983497:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170110464 00000100:00100000:2.0:1784756094.983570:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170110592 00000100:00100000:2.0:1784756094.983583:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170110592 00000100:00100000:0.0:1784756094.983618:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 239 00000100:00100000:0.0:1784756094.983634:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170110464:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756094.983667:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 100 00000100:00100000:2.0:1784756094.983692:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+5:2347:x1871452170110592:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1784756094.983756:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:994158a7-52a9-48df-b40e-50a3e29f70de+10:2347:x1871452170110464:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 124us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756094.983766:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 239 00000100:00100000:2.0:1784756094.983797:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+5:2347:x1871452170110592:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 106us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756094.983808:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 100 00000100:00100000:1.0:1784756094.983908:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170110720 00000100:00100000:1.0:1784756094.983913:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170110720 00000100:00100000:1.0:1784756094.983964:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 56 00000100:00100000:1.0:1784756094.983973:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:633fb912-5a65-4a74-b46a-ec98078e3827+5:2347:x1871452170110720:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756094.984004:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:633fb912-5a65-4a74-b46a-ec98078e3827+5:2347:x1871452170110720:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 33us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756094.984010:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 56 00000100:00080000:0.0:1784756094.987818:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784756094.987847:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784756095.257054:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756096.281421:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784756097.305087:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784756097.982549:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756097.982622:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170110848 00000100:00100000:1.0:1784756097.982631:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170110848 00000100:00080000:0.0:1784756097.982751:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784756097.982883:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 31 00000100:00100000:1.0:1784756097.982896:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+5:10930:x1871452170110848:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:1.0:1784756097.982918:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756097.982942:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038200/0xbe94f39231c8516d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d64 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756097.983387:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038000/0xbe94f39231c85174 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756097.983427:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038000/0xbe94f39231c85174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756097.983440:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038000/0xbe94f39231c85174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756097.983630:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784756097.983634:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784756097.987231:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038000/0xbe94f39231c85174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756097.987282:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038200/0xbe94f39231c8516d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d64 expref: 7 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756097.987302:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038000/0xbe94f39231c85174 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d64 expref: 6 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756097.987312:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097c00) 00010000:00010000:1.0:1784756097.987315:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784756097.987319:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185038000, rc 0) 00000100:00100000:1.0:1784756097.987388:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:10930:x1871452170110848:12345-192.168.204.21@tcp:101:rm.0 Request processed in 4494us (4845us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756097.987396:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 31 00000100:00100000:2.0:1784756097.997189:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756097.997429:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170110976 00000100:00100000:1.0:1784756097.997438:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170110976 00000100:00100000:0.0:1784756098.001169:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 32 00000100:00100000:0.0:1784756098.001185:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bfa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:10930:x1871452170110976:12345-192.168.204.21@tcp:101:rm.0 00010000:00010000:0.0:1784756098.001208:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756098.001230:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c8517b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001298:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85182 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001312:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001322:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001421:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85189 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001430:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001437:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001726:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001735:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85182 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001741:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85182 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001747:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aad200 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756098.001751:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85182 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001757:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85182 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001769:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097c00) 00010000:00010000:0.0:1784756098.001772:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756098.001777:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001783:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001803:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001809:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85189 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001827:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001872:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aac200 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756098.001884:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001890:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85189 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001899:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff96f187e1b900) 00010000:00010000:0.0:1784756098.001901:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756098.001904:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85189 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001910:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c85189 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001946:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c8517b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d6b expref: 7 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.001957:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097c00) 00010000:00010000:0.0:1784756098.001959:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784756098.001970:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c8517b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d6b expref: 7 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756098.003286:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aad800, rc 0) 00000100:00100000:0.0:1784756098.003360:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bfa1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:10930:x1871452170110976:12345-192.168.204.21@tcp:101:rm.0 Request processed in 2176us (6177us total) trans 0 rc 301/301 00000100:00100000:0.0:1784756098.003369:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 32 00010000:00010000:1.0:1784756098.330559:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784756098.332173:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc1bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190071552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756098.332254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756098.332352:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190071552 00000100:00100000:1.0:1784756098.332360:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190071552 00000100:00100000:1.0:1784756098.332655:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784756098.332666:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae2dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190071552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784756098.332709:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784756098.332758:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae2dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190071552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756098.332765:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1784756098.332792:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784756098.332820:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bc1bdf80 x1871452190071552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784756114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756098.332859:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc1bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190071552:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1784756098.422122:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1784756099.353278:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756099.360193:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190071808:0@lo:400:kworker.0 00000100:00100000:0.0:1784756099.360239:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190071936:0@lo:400:kworker.0 00000100:00100000:3.0:1784756099.360275:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756099.360350:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190072320:0@lo:400:kworker.0 00000100:00100000:3.0:1784756099.360398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756099.360451:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784756099.360457:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190071680:0@lo:400:kworker.0 00000100:00100000:3.0:1784756099.360496:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756099.360686:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bc583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190072192:0@lo:400:kworker.0 00000100:00100000:3.0:1784756099.360711:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756099.360746:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190071808 00000100:00100000:3.0:1784756099.360753:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190071808 00000100:00100000:3.0:1784756099.360792:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190072192 00000100:00100000:3.0:1784756099.360795:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190072192 00000100:00100000:3.0:1784756099.360820:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784756099.360829:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f185027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190071808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756099.360918:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f185027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190071808:12345-0@lo:400:kworker.0 Request processed in 89us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756099.360925:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784756099.360942:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784756099.360949:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b3437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190072192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756099.360976:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b3437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1871452190072192:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756099.360982:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784756099.361038:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1871452190072192:0@lo:400:kworker.0 00000100:00100000:3.0:1784756099.361051:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190071808:0@lo:400:kworker.0 00000100:00100000:1.0:1784756099.361706:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190072064:0@lo:400:kworker.0 00000100:00100000:1.0:1784756099.361740:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784756099.361782:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190072320 00000100:00100000:1.0:1784756099.361786:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190072320 00000100:00100000:1.0:1784756099.361816:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190072064 00000100:00100000:1.0:1784756099.361819:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190072064 00000100:00100000:1.0:1784756099.361873:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784756099.361881:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b3434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190072320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756099.361919:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b3434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190072320:12345-0@lo:400:kworker.0 Request processed in 39us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756099.361925:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784756099.361938:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784756099.361944:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190072064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756099.361975:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1871452190072064:12345-0@lo:400:kworker.0 Request processed in 31us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756099.361989:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784756099.362008:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190071680 00000100:00100000:1.0:1784756099.362025:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190071680 00000100:00100000:1.0:1784756099.362053:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1784756099.362059:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190071680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784756099.362089:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f9117e42-6e26-4b4a-b619-3540b762413c+19:3301:x1871452190071680:12345-0@lo:400:kworker.0 Request processed in 30us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756099.362095:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:1.0:1784756099.362122:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784756099.362126:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784756099.362150:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96f1bfa18e00 x1871452190072064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784756115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784756099.362161:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1871452190072064:0@lo:400:kworker.0 00000100:00100000:1.0:1784756099.362183:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f9117e42-6e26-4b4a-b619-3540b762413c:3301:1871452190071680:0@lo:400:kworker.0 00000100:00100000:1.0:1784756099.362192:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1784756099.362197:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff96f1bc1bf100, transno 4294967300 00000100:00100000:1.0:1784756099.362206:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bc583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190072320:0@lo:400:kworker.0 00000100:00100000:0.0:1784756099.362994:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756099.363058:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190071936 00000100:00100000:0.0:1784756099.363063:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190071936 00000100:00100000:0.0:1784756099.363102:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784756099.363109:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190071936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784756099.363154:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190071936:12345-0@lo:400:kworker.0 Request processed in 46us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756099.363160:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1784756099.363184:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756099.363204:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1bfa19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190071936:0@lo:400:kworker.0 00000100:00100000:3.0:1784756099.865026:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190072448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756099.865105:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756099.865148:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190072448 00000100:00100000:2.0:1784756099.865158:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190072448 00000100:00100000:2.0:1784756099.865221:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784756099.865233:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b3437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190072448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784756099.865269:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784756099.865335:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b3437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190072448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756099.865342:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784756099.866023:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190072448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784756100.105529:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756100.105579:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756100.105627:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756100.105750:0:8479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170111360 00000100:00100000:1.0:1784756100.105760:0:8479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170111360 00000100:00100000:1.0:1784756100.105827:0:8479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 59 00000100:00100000:1.0:1784756100.105887:0:8479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b3435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:633fb912-5a65-4a74-b46a-ec98078e3827+5:2348:x1871452170111360:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:1.0:1784756100.105958:0:8479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b3435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:633fb912-5a65-4a74-b46a-ec98078e3827+5:2348:x1871452170111360:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 86us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756100.106103:0:8479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 59 00000100:00080000:0.0:1784756100.106933:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784756100.106953:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170111232 00000100:00100000:0.0:1784756100.106958:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170111232 00000100:00100000:0.0:1784756100.107024:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 104 00000100:00100000:0.0:1784756100.107032:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b3434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170111232:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:0.0:1784756100.107072:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b3434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170111232:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 41us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756100.107079:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 104 00000100:00100000:2.0:1784756100.107171:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170111104 00000100:00100000:2.0:1784756100.107176:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170111104 00000100:00100000:2.0:1784756100.107210:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 241 00000100:00100000:2.0:1784756100.107218:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170111104:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756100.107244:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170111104:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 28us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756100.107250:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 241 00000100:00080000:1.0:1784756100.109024:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784756100.377050:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784756101.408925:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784756101.989693:0:11723:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 119l: test nohybrid flag prevents hybrid IO switching ========================================================== 17:34:58 (1784756098) 00000100:00100000:2.0:1784756102.267805:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756102.267944:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170111616 00000100:00100000:0.0:1784756102.267955:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170111616 00000100:00100000:0.0:1784756102.268035:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 33 00000100:00100000:0.0:1784756102.268047:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:11169:x1871452170111616:12345-192.168.204.21@tcp:101:dd.0 00010000:00010000:0.0:1784756102.268067:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756102.268070:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784756102.268100:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038000/0xbe94f39231c85174 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d64 expref: 6 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.268124:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f1a2097c00) 00010000:00010000:0.0:1784756102.268138:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784756102.268154:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aacc00/0xbe94f39231c85190 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d72 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784756102.268401:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784756102.268491:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85197 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.268504:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85197 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.268514:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85197 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.268583:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c8519e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.268592:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c8519e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.268611:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c8519e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784756102.269380:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1784756102.269646:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c851a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.269659:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c851a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.269668:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c851a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.269701:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85197 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.269709:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85197 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.269716:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85197 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.269722:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aad200 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:0.0:1784756102.269726:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85197 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.269733:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85197 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.269745:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f187e1b900) 00010000:00010000:0.0:1784756102.269748:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784756102.269758:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85197 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.269764:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c85197 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784756102.269776:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee341208 reply state 00000000127eca30 transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c8519e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756102.269784:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784756102.269821:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aacc00/0xbe94f39231c85190 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d72 expref: 8 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.269886:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c851a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d72 expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.269896:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96f187e1b200) 00010000:00010000:0.0:1784756102.269899:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784756102.269901:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aad800, rc 0) 00000100:00100000:0.0:1784756102.269969:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+8:11169:x1871452170111616:12345-192.168.204.21@tcp:101:dd.0 Request processed in 1924us (2184us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784756102.269978:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 33 00010000:00010000:3.0:1784756102.278755:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c8519e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.278781:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c8519e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.278789:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c8519e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.278806:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f186aac200 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:3.0:1784756102.278811:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c8519e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.278820:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c8519e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.278898:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a35613e (ffff96f187e1b800) 00010000:00010000:3.0:1784756102.278902:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756102.278908:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c8519e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.278940:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aac200/0xbe94f39231c8519e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784756102.374982:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756102.375084:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170111744 00000100:00100000:3.0:1784756102.375097:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170111744 00000100:00100000:3.0:1784756102.375156:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 15 00000100:00100000:3.0:1784756102.375166:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1871452170111744:12345-192.168.204.21@tcp:8:kworker.0 00010000:00080000:3.0:1784756102.375385:0:6581:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 633fb912-5a65-4a74-b46a-ec98078e3827@192.168.204.21@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:3.0:1784756102.375437:0:6581:0:(genops.c:1406:class_connect()) connect: client 633fb912-5a65-4a74-b46a-ec98078e3827, cookie 0xbe94f39231c851b3 00002000:00100000:3.0:1784756102.375454:0:6581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 633fb912-5a65-4a74-b46a-ec98078e3827/ffff96f1bc1d2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784756102.375490:0:6581:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784756102.376026:0:6581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784756102.376287:0:6581:0:(import.c:65:import_set_state_nolock()) ffff96f1bc1d4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784756102.376480:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2346:x1871452170111744:12345-192.168.204.21@tcp:8:kworker.0 Request processed in 1311us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756102.376492:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 15 00000100:00100000:0.0:1784756102.387162:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756102.387241:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756102.387506:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170112000 00000100:00100000:3.0:1784756102.387516:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170112000 00000100:00100000:3.0:1784756102.387590:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170111872 00000100:00100000:3.0:1784756102.387593:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170111872 00000100:00100000:3.0:1784756102.387614:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 0 00000100:00100000:3.0:1784756102.387628:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:633fb912-5a65-4a74-b46a-ec98078e3827+7:0:x1871452170112000:12345-192.168.204.21@tcp:4:dd.0 00002000:00010000:3.0:1784756102.387678:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784756102.387686:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ccb46c/0xbe94f39231c851ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.387719:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1784756102.387724:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784756102.387731:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ccb46c/0xbe94f39231c851ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.387748:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ccb46c/0xbe94f39231c851ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784756102.388251:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784756102.425175:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784756102.521374:0:6606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 633fb912-5a65-4a74-b46a-ec98078e3827 00000001:00080000:0.0:1784756102.587450:0:6606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00002000:00010000:3.0:1784756102.587555:0:6585:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1784756102.587560:0:6585:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784756101 00002000:00010000:3.0:1784756102.587563:0:6585:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784756101 00002000:00010000:3.0:1784756102.587564:0:6585:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:3.0:1784756102.587578:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ccb46c/0xbe94f39231c851ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.587592:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010ccb46c/0xbe94f39231c851ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.587613:0:6585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010ccb46c/0xbe94f39231c851ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.587621:0:6585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181500800 already unused, calling callback (ffffffffc1436230) 00010000:00010000:3.0:1784756102.587626:0:6585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ccb46c/0xbe94f39231c851ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.587636:0:6585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ccb46c/0xbe94f39231c851ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.587668:0:6585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010ccb46c/0xbe94f39231c851ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.587676:0:6585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ccb46c/0xbe94f39231c851ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756102.587775:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:0:x1871452170112000:12345-192.168.204.21@tcp:4:dd.0 Request processed in 200149us (200618us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784756102.587799:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 0 00000100:00100000:3.0:1784756102.587830:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 1 00000100:00100000:3.0:1784756102.587874:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:633fb912-5a65-4a74-b46a-ec98078e3827+5:0:x1871452170111872:12345-192.168.204.21@tcp:4:dd.0 00002000:00010000:3.0:1784756102.587912:0:6585:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 2097152, mtime: 0x6a613785, atime: 0x0, ctime: 0x6a613785, blocks: 0x807 00010000:00010000:3.0:1784756102.587918:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b23d2a44/0xbe94f39231c851c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.587930:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=282s v=(0 0) 00010000:00010000:3.0:1784756102.587935:0:6585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784756102.587941:0:6585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b23d2a44/0xbe94f39231c851c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.587952:0:6585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b23d2a44/0xbe94f39231c851c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784756102.671349:0:6585:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:3.0:1784756102.671372:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b23d2a44/0xbe94f39231c851c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.671476:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b23d2a44/0xbe94f39231c851c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.671489:0:6585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b23d2a44/0xbe94f39231c851c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.671497:0:6585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181500a00 already unused, calling callback (ffffffffc1436230) 00010000:00010000:3.0:1784756102.671502:0:6585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b23d2a44/0xbe94f39231c851c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.671510:0:6585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b23d2a44/0xbe94f39231c851c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.671530:0:6585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b23d2a44/0xbe94f39231c851c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756102.671538:0:6585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b23d2a44/0xbe94f39231c851c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756102.671655:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:633fb912-5a65-4a74-b46a-ec98078e3827+7:0:x1871452170111872:12345-192.168.204.21@tcp:4:dd.0 Request processed in 83781us (284408us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1784756102.671666:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 1 00000001:00080000:0.0:1784756102.672231:0:6606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:1.0:1784756102.707184:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756102.707312:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170112256 00000100:00100000:0.0:1784756102.707323:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170112256 00000100:00100000:0.0:1784756102.707385:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 6 00000100:00100000:0.0:1784756102.707420:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc1bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:633fb912-5a65-4a74-b46a-ec98078e3827+7:11169:x1871452170112256:12345-192.168.204.21@tcp:35:dd.0 00000100:00100000:0.0:1784756102.707774:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc1bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:633fb912-5a65-4a74-b46a-ec98078e3827+8:11169:x1871452170112256:12345-192.168.204.21@tcp:35:dd.0 Request processed in 355us (598us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784756102.707781:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 6 00000100:00100000:1.0:1784756102.817689:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756102.817893:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170112384 00000100:00100000:0.0:1784756102.817905:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170112384 00000100:00100000:0.0:1784756102.817972:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 34 00000100:00100000:0.0:1784756102.817983:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+8:11177:x1871452170112384:12345-192.168.204.21@tcp:101:dd.0 00010000:00010000:0.0:1784756102.818010:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756102.818034:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c851c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.818104:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c851cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.818120:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c851cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.818132:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c851cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756102.818206:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784756102.818211:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784756102.818237:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c851cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.818274:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad200/0xbe94f39231c851c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d79 expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.818317:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aaca00/0xbe94f39231c851cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d79 expref: 9 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.818326:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f187e1b900) 00010000:00010000:0.0:1784756102.818329:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784756102.818332:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f186aaca00, rc 0) 00000100:00100000:0.0:1784756102.818390:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+9:11177:x1871452170112384:12345-192.168.204.21@tcp:101:dd.0 Request processed in 408us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756102.818396:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 34 00000100:00100000:3.0:1784756102.828536:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756102.829274:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170112640 00000100:00100000:1.0:1784756102.829286:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170112640 00000100:00100000:1.0:1784756102.829357:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 35 00000100:00100000:1.0:1784756102.829368:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b3435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+9:11177:x1871452170112640:12345-192.168.204.21@tcp:101:dd.0 00010000:00010000:1.0:1784756102.829389:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756102.829423:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038800/0xbe94f39231c851d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d80 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.829531:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c851dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.829545:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c851dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.829558:0:5781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c851dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5781 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784756102.829570:0:5781:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 2097152 00010000:00010000:1.0:1784756102.829716:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038800/0xbe94f39231c851d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d80 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.829736:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c851dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d80 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.829764:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96f187e1b200) 00010000:00010000:1.0:1784756102.829767:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784756102.829771:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185038e00, rc 0) 00000100:00100000:1.0:1784756102.830369:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b3435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+11:11177:x1871452170112640:12345-192.168.204.21@tcp:101:dd.0 Request processed in 1000us (1842us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1784756102.830377:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 35 00000100:00100000:1.0:1784756102.841756:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756102.841897:0:7485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170112768 00000100:00100000:0.0:1784756102.841909:0:7485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170112768 00000100:00100000:0.0:1784756102.841973:0:7485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2 00000100:00100000:0.0:1784756102.841984:0:7485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:633fb912-5a65-4a74-b46a-ec98078e3827+11:2349:x1871452170112768:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784756102.842001:0:7485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756102.842026:0:7485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f185038e00/0xbe94f39231c851dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d80 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756102.842046:0:7485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96f187e1b200) 00010000:00010000:0.0:1784756102.842050:0:7485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784756102.842093:0:7485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:633fb912-5a65-4a74-b46a-ec98078e3827+10:2349:x1871452170112768:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 111us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756102.842100:0:7485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2 00000100:00100000:3.0:1784756102.860639:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756102.865549:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170112896 00000100:00100000:1.0:1784756102.865563:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170112896 00000100:00100000:1.0:1784756102.865644:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 16 00000100:00100000:1.0:1784756102.865653:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b3434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:633fb912-5a65-4a74-b46a-ec98078e3827+5:2350:x1871452170112896:12345-192.168.204.21@tcp:101:dd.0 00010000:00010000:1.0:1784756102.865672:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756102.865696:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045dbaf88/0xbe94f39231c851eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d87 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784756102.865721:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 2097152, mtime: 0x6a613785, atime: 0x0, ctime: 0x6a613785, blocks: 0x1007 00010000:00010000:1.0:1784756102.865739:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=283s v=(0 0) 00010000:00010000:1.0:1784756102.865744:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756102.865752:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045dbaf88/0xbe94f39231c851eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d87 expref: 6 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.865772:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045dbaf88/0xbe94f39231c851eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d87 expref: 6 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.865797:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185038800, rc 0) 00000100:00100000:1.0:1784756102.865914:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b3434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:2350:x1871452170112896:12345-192.168.204.21@tcp:101:dd.0 Request processed in 260us (5282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756102.865921:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 16 00000100:00100000:2.0:1784756102.930509:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756102.930564:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756102.930810:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170113152 00000100:00100000:1.0:1784756102.930821:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170113152 00000100:00100000:1.0:1784756102.930928:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170113024 00000100:00100000:1.0:1784756102.930932:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170113024 00000100:00100000:1.0:1784756102.930956:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 2 00000100:00100000:1.0:1784756102.930968:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bc583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:633fb912-5a65-4a74-b46a-ec98078e3827+7:2349:x1871452170113152:12345-192.168.204.21@tcp:3:dd.0 00010000:00010000:1.0:1784756102.931004:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000308b4d80/0xbe94f39231c851f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.931022:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756102.931026:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756102.931033:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000308b4d80/0xbe94f39231c851f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.931048:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000308b4d80/0xbe94f39231c851f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.967686:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000308b4d80/0xbe94f39231c851f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.967707:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000308b4d80/0xbe94f39231c851f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.967716:0:6586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000308b4d80/0xbe94f39231c851f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.967743:0:6586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f185038400 already unused, calling callback (ffffffffc1436230) 00010000:00010000:1.0:1784756102.967748:0:6586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000308b4d80/0xbe94f39231c851f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.967758:0:6586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000308b4d80/0xbe94f39231c851f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.967788:0:6586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000308b4d80/0xbe94f39231c851f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.967797:0:6586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000308b4d80/0xbe94f39231c851f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756102.967926:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bc583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:633fb912-5a65-4a74-b46a-ec98078e3827+7:2349:x1871452170113152:12345-192.168.204.21@tcp:3:dd.0 Request processed in 36955us (37432us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1784756102.967938:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 2 00000100:00100000:1.0:1784756102.967971:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3 00000100:00100000:1.0:1784756102.967983:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2349:x1871452170113024:12345-192.168.204.21@tcp:3:dd.0 00010000:00010000:1.0:1784756102.968020:0:6586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bdca5c46/0xbe94f39231c851f9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.968032:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756102.968036:0:6586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756102.968043:0:6586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdca5c46/0xbe94f39231c851f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756102.968067:0:6586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdca5c46/0xbe94f39231c851f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.002988:0:6586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bdca5c46/0xbe94f39231c851f9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.003011:0:6586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdca5c46/0xbe94f39231c851f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.003021:0:6586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdca5c46/0xbe94f39231c851f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.003028:0:6586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f185038a00 already unused, calling callback (ffffffffc1436230) 00010000:00010000:1.0:1784756103.003033:0:6586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdca5c46/0xbe94f39231c851f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.003042:0:6586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdca5c46/0xbe94f39231c851f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.003063:0:6586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdca5c46/0xbe94f39231c851f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.003071:0:6586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdca5c46/0xbe94f39231c851f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756103.003166:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:633fb912-5a65-4a74-b46a-ec98078e3827+6:2349:x1871452170113024:12345-192.168.204.21@tcp:3:dd.0 Request processed in 35181us (72596us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1784756103.003205:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3 00000100:00100000:0.0:1784756103.041036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756103.041198:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170113408 00000100:00100000:3.0:1784756103.041217:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170113408 00000100:00100000:3.0:1784756103.041317:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 7 00000100:00100000:3.0:1784756103.041330:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:633fb912-5a65-4a74-b46a-ec98078e3827+10:11177:x1871452170113408:12345-192.168.204.21@tcp:35:dd.0 00000100:00100000:2.0:1784756103.045550:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:633fb912-5a65-4a74-b46a-ec98078e3827+11:11177:x1871452170113408:12345-192.168.204.21@tcp:35:dd.0 Request processed in 4205us (4504us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1784756103.045575:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 7 00000100:00100000:2.0:1784756103.106472:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756103.107459:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170113664 00000100:00100000:0.0:1784756103.107474:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170113664 00000100:00100000:0.0:1784756103.107562:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 36 00000100:00100000:0.0:1784756103.107574:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+11:11181:x1871452170113664:12345-192.168.204.21@tcp:101:lfs.0 00010000:00010000:0.0:1784756103.107602:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784756103.107627:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85200 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d8e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.107729:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc450800/0xbe94f39231c85207 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.107745:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc450800/0xbe94f39231c85207 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.107758:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc450800/0xbe94f39231c85207 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784756103.107769:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 2097152 00010000:00010000:0.0:1784756103.107960:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85200 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d8e expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.107979:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc450800/0xbe94f39231c85207 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d8e expref: 13 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.107989:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96f187e1b200) 00010000:00010000:0.0:1784756103.107992:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784756103.107995:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f1bc450800, rc 0) 00000100:00100000:0.0:1784756103.108070:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:633fb912-5a65-4a74-b46a-ec98078e3827+13:11181:x1871452170113664:12345-192.168.204.21@tcp:101:lfs.0 Request processed in 498us (1612us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1784756103.108077:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 36 00000100:00100000:1.0:1784756103.118922:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756103.119042:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170113920 00000100:00100000:0.0:1784756103.119076:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170113920 00000100:00100000:0.0:1784756103.119171:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 37 00000100:00100000:0.0:1784756103.119184:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+13:11181:x1871452170113920:12345-192.168.204.21@tcp:36:lfs.0 00010000:00010000:0.0:1784756103.119253:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784756103.119281:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f186aad800/0xbe94f39231c851a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d72 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.119303:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96f187e1b200) 00010000:00010000:0.0:1784756103.119309:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784756103.119334:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85215 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.119348:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.119359:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784756103.119562:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008fd2527f reply state 000000003a366cb9 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784756103.119572:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784756103.119689:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:633fb912-5a65-4a74-b46a-ec98078e3827+14:11181:x1871452170113920:12345-192.168.204.21@tcp:36:lfs.0 Request processed in 507us (780us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1784756103.119698:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 37 00010000:00010000:2.0:1784756103.124254:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85215 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756103.124273:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85215 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756103.124280:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85215 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756103.124287:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1bc451600 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:2.0:1784756103.124292:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85215 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756103.124301:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85215 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756103.124325:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96f187e1b200) 00010000:00010000:2.0:1784756103.124329:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784756103.124334:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85215 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784756103.124340:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f1bc451600/0xbe94f39231c85215 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756103.124872:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756103.125759:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170114048 00000100:00100000:2.0:1784756103.125773:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170114048 00000100:00100000:2.0:1784756103.125875:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 17 00000100:00100000:2.0:1784756103.126315:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1861a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170114048:12345-192.168.204.21@tcp:2:lfs.0 00002000:00010000:2.0:1784756103.126745:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1784756103.126749:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 1784756101 -> 1784756101 00002000:00010000:2.0:1784756103.126751:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784756103.126753:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 1784756101 -> 1784756101 00002000:00010000:2.0:1784756103.126755:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 4103 -> 4103 00000100:00100000:2.0:1784756103.126875:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1861a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:633fb912-5a65-4a74-b46a-ec98078e3827+7:2348:x1871452170114048:12345-192.168.204.21@tcp:2:lfs.0 Request processed in 976us (2052us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784756103.126885:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 17 00000100:00100000:0.0:1784756103.174202:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756103.174375:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170114176 00000100:00100000:3.0:1784756103.174508:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170114176 00000100:00100000:3.0:1784756103.174625:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 3 00000100:00100000:3.0:1784756103.174637:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633fb912-5a65-4a74-b46a-ec98078e3827+7:5559:x1871452170114176:12345-192.168.204.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784756103.174657:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784756103.174709:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045dbaf88/0xbe94f39231c851eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d87 expref: 7 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.174742:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784756103.174827:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633fb912-5a65-4a74-b46a-ec98078e3827+6:5559:x1871452170114176:12345-192.168.204.21@tcp:103:ldlm_bl.0 Request processed in 192us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756103.174889:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 3 00000100:00100000:1.0:1784756103.236445:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:3.0:1784756103.236563:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170114432 00000100:00100000:3.0:1784756103.236576:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170114432 00000100:00100000:3.0:1784756103.236668:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 38 00000100:00100000:3.0:1784756103.236681:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+13:11188:x1871452170114432:12345-192.168.204.21@tcp:101:dd.0 00010000:00010000:3.0:1784756103.236715:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784756103.236745:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500a00/0xbe94f39231c8521c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d95 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.236950:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c85223 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.236969:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c85223 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237005:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c85223 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237023:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c8522a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237031:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c8522a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237037:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c8522a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237206:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c85231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237217:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c85231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237225:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c85231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784756103.237236:0:6601:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 2097152 00010000:00010000:3.0:1784756103.237371:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c85223 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237380:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c85223 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237386:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c85223 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237398:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181500400 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:3.0:1784756103.237411:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c85223 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237420:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c85223 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237438:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96f187e1b900) 00010000:00010000:3.0:1784756103.237441:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756103.237447:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c85223 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237454:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500400/0xbe94f39231c85223 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237477:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c8522a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237484:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c8522a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237490:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c8522a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237496:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f181501200 already unused, calling callback (ffffffffc1e3f4f0) 00010000:00010000:3.0:1784756103.237499:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c8522a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237505:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c8522a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237513:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6a35613e (ffff96f186bd5600) 00010000:00010000:3.0:1784756103.237515:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784756103.237525:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c8522a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237531:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f181501200/0xbe94f39231c8522a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6a35613e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6601 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237604:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500a00/0xbe94f39231c8521c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d95 expref: 16 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237624:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96f181500800/0xbe94f39231c85231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d95 expref: 15 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.237631:0:6601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff96f187e1b200) 00010000:00010000:3.0:1784756103.237634:0:6601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784756103.237637:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f181500800, rc 0) 00000100:00100000:3.0:1784756103.237742:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:633fb912-5a65-4a74-b46a-ec98078e3827+15:11188:x1871452170114432:12345-192.168.204.21@tcp:101:dd.0 Request processed in 1062us (1313us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1784756103.237751:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 38 00000100:00100000:0.0:1784756103.242443:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756103.242549:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170114688 00000100:00100000:1.0:1784756103.242562:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170114688 00000100:00100000:1.0:1784756103.242633:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 8 00000100:00100000:1.0:1784756103.242645:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:633fb912-5a65-4a74-b46a-ec98078e3827+15:11188:x1871452170114688:12345-192.168.204.21@tcp:35:dd.0 00000100:00100000:1.0:1784756103.243212:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:633fb912-5a65-4a74-b46a-ec98078e3827+16:11188:x1871452170114688:12345-192.168.204.21@tcp:35:dd.0 Request processed in 568us (781us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1784756103.243221:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 8 00000100:00100000:2.0:1784756103.254971:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:1.0:1784756103.255934:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170114816 00000100:00100000:1.0:1784756103.255962:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170114816 00000100:00100000:1.0:1784756103.256073:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 18 00000100:00100000:1.0:1784756103.256086:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:633fb912-5a65-4a74-b46a-ec98078e3827+6:2348:x1871452170114816:12345-192.168.204.21@tcp:101:dd.0 00010000:00010000:1.0:1784756103.256115:0:6579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784756103.256154:0:6579:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045dbaf88/0xbe94f39231c8523f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d35c94788bd1d9c expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784756103.256198:0:6579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 2097152, mtime: 0x6a613785, atime: 0x0, ctime: 0x6a613785, blocks: 0x1007 00010000:00010000:1.0:1784756103.256232:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=283s v=(0 0) 00010000:00010000:1.0:1784756103.256239:0:6579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784756103.256252:0:6579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045dbaf88/0xbe94f39231c8523f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d9c expref: 7 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.256308:0:6579:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045dbaf88/0xbe94f39231c8523f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.21@tcp remote: 0x5d35c94788bd1d9c expref: 7 pid: 6579 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.256326:0:6579:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96f185038800, rc 0) 00000100:00100000:1.0:1784756103.256566:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:633fb912-5a65-4a74-b46a-ec98078e3827+7:2348:x1871452170114816:12345-192.168.204.21@tcp:101:dd.0 Request processed in 480us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1784756103.256577:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 18 00000100:00100000:2.0:1784756103.334815:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756103.334985:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170114944 00000100:00100000:0.0:1784756103.334995:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170114944 00000100:00100000:0.0:1784756103.335072:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 4 00000100:00100000:0.0:1784756103.335100:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bf546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:633fb912-5a65-4a74-b46a-ec98078e3827+7:2350:x1871452170114944:12345-192.168.204.21@tcp:3:dd.0 00010000:00010000:0.0:1784756103.335143:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000abbd6ef/0xbe94f39231c85246 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.335173:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756103.335177:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756103.335184:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000abbd6ef/0xbe94f39231c85246 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.335201:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000abbd6ef/0xbe94f39231c85246 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756103.336110:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:0.0:1784756103.336901:0:6586:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1784756103.336919:0:6586:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1784756103.338452:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170115072 00000100:00100000:1.0:1784756103.338470:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170115072 00000100:00100000:0.0:1784756103.339039:0:11736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 5 00000100:00100000:0.0:1784756103.339051:0:11736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:633fb912-5a65-4a74-b46a-ec98078e3827+9:2350:x1871452170115072:12345-192.168.204.21@tcp:3:dd.0 00010000:00010000:0.0:1784756103.339087:0:11736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a7bbed5/0xbe94f39231c8524d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.339103:0:11736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756103.339107:0:11736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784756103.339114:0:11736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a7bbed5/0xbe94f39231c8524d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784756103.339129:0:11736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a7bbed5/0xbe94f39231c8524d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.389096:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000abbd6ef/0xbe94f39231c85246 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.389266:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000abbd6ef/0xbe94f39231c85246 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.389277:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000abbd6ef/0xbe94f39231c85246 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.389284:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1bc451200 already unused, calling callback (ffffffffc1436230) 00010000:00010000:3.0:1784756103.389289:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000abbd6ef/0xbe94f39231c85246 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.389310:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000abbd6ef/0xbe94f39231c85246 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.389334:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000abbd6ef/0xbe94f39231c85246 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784756103.389342:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000abbd6ef/0xbe94f39231c85246 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784756103.389430:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bf546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:633fb912-5a65-4a74-b46a-ec98078e3827+9:2350:x1871452170114944:12345-192.168.204.21@tcp:3:dd.0 Request processed in 54328us (54620us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1784756103.389440:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 4 00010000:00010000:1.0:1784756103.416342:0:11736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a7bbed5/0xbe94f39231c8524d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.416364:0:11736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a7bbed5/0xbe94f39231c8524d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.416373:0:11736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a7bbed5/0xbe94f39231c8524d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.416380:0:11736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96f1bc450000 already unused, calling callback (ffffffffc1436230) 00010000:00010000:1.0:1784756103.416385:0:11736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a7bbed5/0xbe94f39231c8524d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.416395:0:11736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a7bbed5/0xbe94f39231c8524d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.416437:0:11736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a7bbed5/0xbe94f39231c8524d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784756103.416444:0:11736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a7bbed5/0xbe94f39231c8524d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784756103.416553:0:11736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:633fb912-5a65-4a74-b46a-ec98078e3827+7:2350:x1871452170115072:12345-192.168.204.21@tcp:3:dd.0 Request processed in 77500us (80452us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1784756103.416563:0:11736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 5 00000100:00100000:1.0:1784756103.450860:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784756103.450885:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b4d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190072576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784756103.450973:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756103.453349:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190072576 00000100:00100000:2.0:1784756103.453365:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190072576 00010000:00010000:3.0:1784756103.453377:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784756103.453435:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784756103.453468:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784756103.453476:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1784756103.453483:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190072576:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784756103.453496:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1784756103.453513:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3855613952 00000100:00100000:2.0:1784756103.453619:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1bbd15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190072576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (2657us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756103.453629:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784756103.453702:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b4d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190072576:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1784756103.578928:0:5804:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967314 is committed 00000001:00080000:1.0:1784756103.578968:0:5804:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000100:00100000:3.0:1784756104.474862:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b3437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190072960:0@lo:400:kworker.0 00000100:00100000:3.0:1784756104.474974:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756104.474984:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190072704:0@lo:400:kworker.0 00000100:00100000:0.0:1784756104.475035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756104.475062:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784756104.475070:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b3436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190073088:0@lo:400:kworker.0 00000100:00100000:3.0:1784756104.475104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784756104.475143:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190073088 00000100:00100000:3.0:1784756104.475153:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190073088 00000100:00100000:0.0:1784756104.475178:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b3435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190073216:0@lo:400:kworker.0 00000100:00100000:3.0:1784756104.475219:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784756104.475232:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b3435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190073088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784756104.475295:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b3435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190073088:12345-0@lo:400:kworker.0 Request processed in 65us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756104.475322:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:3.0:1784756104.475394:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784756104.475434:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b3436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190073088:0@lo:400:kworker.0 00000100:00100000:2.0:1784756104.475517:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b3435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190072832:0@lo:400:kworker.0 00000100:00100000:2.0:1784756104.475553:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756104.475592:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1b3434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190073344:0@lo:400:kworker.0 00000100:00100000:2.0:1784756104.475615:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784756104.475647:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190073344 00000100:00100000:2.0:1784756104.475651:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190073344 00000100:00100000:2.0:1784756104.475705:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784756104.475712:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190073344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756104.475765:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1871452190073344:12345-0@lo:400:kworker.0 Request processed in 53us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756104.475772:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784756104.475816:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b3434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1871452190073344:0@lo:400:kworker.0 00000100:00100000:2.0:1784756104.475899:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190072960 00000100:00100000:2.0:1784756104.475904:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190072960 00000100:00100000:2.0:1784756104.475937:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190072832 00000100:00100000:2.0:1784756104.475941:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190072832 00000100:00100000:2.0:1784756104.475962:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784756104.475968:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b3436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190072960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756104.476006:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b3436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1871452190072960:12345-0@lo:400:kworker.0 Request processed in 38us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756104.476012:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784756104.476024:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784756104.476029:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190072832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756104.476062:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1871452190072832:12345-0@lo:400:kworker.0 Request processed in 31us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756104.476069:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784756104.476096:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b3435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1871452190072832:0@lo:400:kworker.0 00000100:00100000:2.0:1784756104.476130:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190072704 00000100:00100000:2.0:1784756104.476135:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190072704 00000100:00100000:2.0:1784756104.476161:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784756104.476167:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190072704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756104.476202:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f9117e42-6e26-4b4a-b619-3540b762413c+19:3300:x1871452190072704:12345-0@lo:400:kworker.0 Request processed in 35us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756104.476218:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:3.0:1784756104.476541:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784756104.476547:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784756104.476577:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b3437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1871452190072960:0@lo:400:kworker.0 00000100:00100000:0.0:1784756104.479884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756104.479983:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b3436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9117e42-6e26-4b4a-b619-3540b762413c:3300:1871452190072704:0@lo:400:kworker.0 00000100:00100000:2.0:1784756104.480370:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190073216 00000100:00100000:2.0:1784756104.480380:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190073216 00000100:00100000:2.0:1784756104.480479:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784756104.480491:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190073216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784756104.480581:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1871452190073216:12345-0@lo:400:kworker.0 Request processed in 91us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756104.480589:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1784756104.480866:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784756104.480952:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1b3435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1871452190073216:0@lo:400:kworker.0 00000100:00100000:0.0:1784756104.987593:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96f1ae1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190073472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784756104.987661:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784756104.987730:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452190073472 00000100:00100000:0.0:1784756104.987737:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452190073472 00000100:00100000:0.0:1784756104.987790:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784756104.987809:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1ae1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190073472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784756104.987863:0:6583:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784756104.987908:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1ae1ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1871452190073472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784756104.987914:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784756104.987965:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96f1ae1ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1871452190073472:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1784756105.197237:0:11777:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_119l: @@@@@@ FAIL: (5) nohybrid should prevent switch, stats: 1 00000100:00100000:2.0:1784756105.227591:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756105.227634:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756105.227659:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756105.227680:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.21@tcp (source: 12345-192.168.204.21@tcp) 00000100:00100000:2.0:1784756105.227706:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170115456 00000100:00100000:2.0:1784756105.227715:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170115456 00000100:00100000:2.0:1784756105.227780:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170115584 00000100:00100000:2.0:1784756105.227785:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170115584 00000100:00100000:2.0:1784756105.227806:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 62 00000100:00100000:2.0:1784756105.227815:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:633fb912-5a65-4a74-b46a-ec98078e3827+7:2348:x1871452170115456:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756105.227903:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:633fb912-5a65-4a74-b46a-ec98078e3827+7:2348:x1871452170115456:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 89us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756105.227910:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 62 00000100:00100000:2.0:1784756105.227926:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 63 00000100:00100000:2.0:1784756105.227933:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:633fb912-5a65-4a74-b46a-ec98078e3827+5:2348:x1871452170115584:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756105.227957:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:633fb912-5a65-4a74-b46a-ec98078e3827+5:2348:x1871452170115584:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756105.227982:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 63 00000100:00100000:2.0:1784756105.228002:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170115328 00000100:00100000:2.0:1784756105.228005:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170115328 00000100:00100000:2.0:1784756105.228033:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 108 00000100:00100000:2.0:1784756105.228039:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1b4d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+8:2348:x1871452170115328:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:2.0:1784756105.228073:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1b4d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:633fb912-5a65-4a74-b46a-ec98078e3827+8:2348:x1871452170115328:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 33us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1784756105.228079:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 108 00000100:00080000:2.0:1784756105.228100:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784756105.228104:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784756105.228107:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784756105.228564:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871452170115200 00000100:00100000:3.0:1784756105.228570:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871452170115200 00000100:00100000:3.0:1784756105.228617:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.21@tcp, seq: 243 00000100:00100000:3.0:1784756105.228627:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96f1850d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170115200:12345-192.168.204.21@tcp:400:kworker.0 00000100:00100000:3.0:1784756105.228676:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96f1850d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:994158a7-52a9-48df-b40e-50a3e29f70de+10:2348:x1871452170115200:12345-192.168.204.21@tcp:400:kworker.0 Request processed in 51us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1784756105.228683:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.21@tcp, seq: 243 00010000:00010000:1.0:1784756105.498066:0:11354:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784756106.522316:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9901 lines, 9901 kept, 0 dropped, 0 bad.